00000001:02000400:1.0F:1788940155.958891:0:2961:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg214-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1788940175.657866:0:3182:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg214-server.virtnet: executing load_modules_local 00000001:01000000:1.0:1788940177.863211:0:3244:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 443 MB/s 00000001:01000000:3.0:1788940178.115216:0:3244:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 337 MB/s 00000001:01000000:1.0:1788940178.370750:0:3244:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 6083 MB/s 00000020:02000000:2.0F:1788940179.870594:0:3273:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_2_g930488d 00000400:02000000:2.0:1788940180.733691:0:3289:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.202.114@tcp [8/256/0/180] 00008000:02000000:1.0:1788940185.653254:0:3438:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0:1788940256.912746:0:5266:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg214-server.virtnet: executing load_modules_local 00000020:01000004:0.0F:1788940269.845700:0:5841:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788940269.845713:0:5841:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1788940269.845827:0:5841:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000c0d78060 00000080:02000400:0.0:1788940269.846285:0:5841:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1788940269.866036:0:5841:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1788940269.866051:0:5841:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788940269.866094:0:5841:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0000-osd (000000008214ec6d) 00000020:00000080:0.0:1788940269.866119:0:5841:0:(obd_config.c:786:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788940269.908098:0:5841:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1788940269.911426:0:5841:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788940270.022896:0:5841:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788940270.022938:0:5841:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788940270.024380:0:5841:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788940270.024460:0:5841:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788940270.024797:0:5841:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788940270.025899:0:5841:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788940270.025908:0:5841:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788940270.025918:0:5841:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x27a633fcdd4a798 00000020:01000004:2.0:1788940270.025927:0:5841:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788940270.025934:0:5841:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788940270.025939:0:5841:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000c0d78060 from MGS 00000020:01000004:2.0:1788940270.027464:0:5841:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788940270.028954:0:5841:0:(genops.c:415:class_newdev()) Allocate new device MGS (0000000083dbe8f7) 00000020:00000080:2.0:1788940270.028985:0:5841:0:(obd_config.c:786:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788940270.029132:0:5841:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c0d78060 from MGS, refs=2 00080000:01000000:2.0:1788940270.029141:0:5841:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788940270.029149:0:5841:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x27a633fcdd4a7a6 00000100:00100000:3.0:1788940270.029701:0:5841:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788940270.029838:0:5841:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788940270.029844:0:5841:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788940270.030648:0:5841:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788940270.030657:0:5841:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788940270.033012:0:5841:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788940270.033446:0:5841:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788940270.033455:0:5841:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788940270.035903:0:5841:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788940270.035914:0:5841:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788940270.036687:0:5841:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788940270.036694:0:5841:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788940270.054757:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940270.054763:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940270.054765:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940270.055954:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940270.055958:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940270.055960:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940270.057448:0:5841:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788940270.074141:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1788940270.306612:0:5841:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 1131 MB/s 00000001:01000000:3.0:1788940270.556610:0:5841:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2803 MB/s 00000001:01000000:2.0:1788940270.811500:0:5841:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 433 MB/s 00000001:01000000:2.0:1788940271.079002:0:5841:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 225 MB/s 00010000:00010000:2.0:1788940271.090030:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:0.0:1788940271.122691:0:5841:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:3.0:1788940271.188302:0:5841:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1788940271.188320:0:5841:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788940271.188323:0:5841:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1788940271.195866:0:5851:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788940271.196066:0:5841:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788940271.196139:0:5841:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1788940271.196372:0:5841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1788940271.196397:0:5841:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788940271.197170:0:5841:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788940271.197366:0:5841:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788940271.197372:0:5841:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788940271.208369:0:5841:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788940271.208412:0:5841:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788940271.215469:0:5841:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788940271.215494:0:5841:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788940271.262043:0:5841:0:(obd_config.c:900:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788940271.262067:0:5841:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.114@tcp' 00000020:01000004:0.0:1788940271.262069:0:5841:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788940271.262122:0:5841:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.114@tcp (typ=mgc) 00000020:00000080:0.0:1788940271.262133:0:5841:0:(genops.c:415:class_newdev()) Allocate new device MGC192.168.202.114@tcp (00000000e27cae8b) 00000020:00000080:0.0:1788940271.262150:0:5841:0:(obd_config.c:786:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788940271.262257:0:5841:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000069faba72@MGC192.168.202.114@tcp: add connection 192.168.202.114@tcp at head 00010000:00010000:0.0:1788940271.262421:0:5841:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.114@tcp-0 is initialized 00000040:01000000:0.0:1788940271.262427:0:5841:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.114@tcp ctxt 1 is initialized 10000000:01000000:0.0:1788940271.266397:0:5858:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788940271.266555:0:5841:0:(obd_config.c:900:class_setup()) finished setup of obd MGC192.168.202.114@tcp (uuid 1220f165-b68f-42ea-b6cd-5f8ad1a18830) 00000020:00000080:0.0:1788940271.267089:0:5841:0:(genops.c:1393:class_connect()) connect: client 1220f165-b68f-42ea-b6cd-5f8ad1a18830, cookie 0x27a633fcdd4a7b4 00000100:00080000:0.0:1788940271.267105:0:5841:0:(import.c:545:import_select_connection()) MGC192.168.202.114@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788940271.267111:0:5841:0:(import.c:665:import_select_connection()) MGC192.168.202.114@tcp: import 0000000069faba72 using connection 192.168.202.114@tcp/0@lo 00000100:00100000:0.0:1788940271.267163:0:5841:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000feca3a03 x1875839738183808/t0(0) o250->MGC192.168.202.114@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788940271.267193:0:5841:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import 1220f165-b68f-42ea-b6cd-5f8ad1a18830->MGS 00000020:01000004:0.0:1788940271.267215:0:5841:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788940271.267225:0:5841:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788940271.267238:0:5841:0:(genops.c:415:class_newdev()) Allocate new device MDS (00000000775e5d61) 00000020:00000080:0.0:1788940271.267250:0:5841:0:(obd_config.c:786:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788940271.272443:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000feca3a03 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3304:1875839738183808:0@lo:250: 00000100:00100000:1.0:1788940271.272602:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940271.272707:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738183808 00000100:00100000:1.0:1788940271.272717:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738183808 00000100:00100000:1.0:1788940271.272768:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788940271.272776:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d4e0147a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3304:x1875839738183808:12345-0@lo:250: 00010000:00080000:1.0:1788940271.272805:0:5853:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 1220f165-b68f-42ea-b6cd-5f8ad1a18830@0@lo t0 exp 0000000000000000 cur 214 last 0 00000020:00000080:1.0:1788940271.272842:0:5853:0:(genops.c:1393:class_connect()) connect: client 1220f165-b68f-42ea-b6cd-5f8ad1a18830, cookie 0x27a633fcdd4a7c2 00000100:00080000:1.0:1788940271.273006:0:5853:0:(import.c:65:import_set_state_nolock()) 00000000d5f44fa3 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788940271.273063:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d4e0147a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+5:3304:x1875839738183808:12345-0@lo:250: Request processed in 287us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940271.273070:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788940271.273112:0:3304:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.114@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1788940271.273122:0:3304:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.202.114@tcp: connect to target with instance 0 00000100:00080000:1.0:1788940271.273129:0:3304:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.202.114@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788940271.273141:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788940271.273145:0:3304:0:(import.c:65:import_set_state_nolock()) 0000000069faba72 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788940271.273147:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788940271.273150:0:3304:0:(pinger.c:187:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788940271.273154:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000feca3a03 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3304:1875839738183808:0@lo:250: 00000100:00080000:2.0:1788940271.275463:0:5856:0:(pinger.c:501:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:1.0:1788940271.340926:0:5841:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788940271.341157:0:5841:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788940271.341165:0:5841:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788940271.344735:0:5841:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788940271.344750:0:5841:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788940271.359407:0:5841:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788940271.359627:0:5841:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788940271.361834:0:5841:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788940271.362338:0:5841:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788940271.362345:0:5841:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788940271.366958:0:5841:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788940271.366974:0:5841:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788940271.557565:0:5841:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788940271.557811:0:5841:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788940271.557818:0:5841:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788940271.565881:0:5841:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788940271.565897:0:5841:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788940271.569670:0:5841:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788940271.570061:0:5841:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788940271.570068:0:5841:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788940271.574188:0:5841:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788940271.574225:0:5841:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788940271.586397:0:5841:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788940271.586688:0:5841:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788940271.586695:0:5841:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788940271.592052:0:5841:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788940271.592075:0:5841:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788940271.594774:0:5841:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788940271.594994:0:5841:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788940271.595001:0:5841:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788940271.601877:0:5841:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788940271.601893:0:5841:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788940271.713707:0:5841:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788940271.714224:0:5841:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788940271.714232:0:5841:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788940271.729968:0:5841:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788940271.729983:0:5841:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788940271.771729:0:5841:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788940271.771751:0:5841:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788940271.777557:0:5841:0:(obd_config.c:900:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788940271.777580:0:5841:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1788940271.777594:0:5841:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.114@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788940271.777712:0:5841:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.114@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788940271.777746:0:5841:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.114@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1788940271.777750:0:5841:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788940271.777752:0:5841:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788940271.777753:0:5841:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788940271.777754:0:5841:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788940271.777755:0:5841:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788940271.777756:0:5841:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788940271.777758:0:5841:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788940271.777759:0:5841:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788940271.777764:0:5841:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788940271.777765:0:5841:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788940271.777767:0:5841:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788940271.777768:0:5841:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788940271.777770:0:5841:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1788940271.777772:0:5841:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788940271.777773:0:5841:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788940271.777774:0:5841:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788940271.777775:0:5841:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788940271.777776:0:5841:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788940271.777777:0:5841:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788940271.777777:0:5841:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788940271.777778:0:5841:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788940271.777779:0:5841:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788940271.777779:0:5841:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788940271.777780:0:5841:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788940271.777781:0:5841:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788940271.777825:0:5841:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788940271.777843:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ceb60795 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5841:1875839738183936:0@lo:253: 00000100:00100000:3.0:1788940271.777948:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940271.778000:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set 000000002ac7a09b going to sleep for 11 seconds 00000100:00100000:0.0:1788940271.778488:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738183936 00000100:00100000:0.0:1788940271.778497:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738183936 00000100:00100000:0.0:1788940271.778591:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788940271.778601:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bc11af96 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+5:5841:x1875839738183936:12345-0@lo:253: 20000000:01000000:0.0:1788940271.778652:0:5855:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788940271.778654:0:5855:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1788940271.778813:0:5876:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788940271.778839:0:5855:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1788940271.779348:0:5855:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788940271.796381:0:5877:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1788940271.797033:0:5855:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788940271.797038:0:5855:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1788940271.797043:0:5855:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1788940271.797046:0:5855:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1788940271.797061:0:5855:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1788940271.797280:0:5855:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788940271.797778:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1788940271.797791:0:5855:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788940271.797838:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1788940271.798008:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1788940271.798050:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1788940271.798147:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1788940271.798156:0:5855:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1788940271.798201:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1788940271.798209:0:5855:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1788940271.798254:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1788940271.798261:0:5855:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1788940271.798289:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1788940271.798337:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1788940271.798366:0:5855:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1788940271.798371:0:5855:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1788940271.798384:0:5855:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788940271.802196:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1788940271.802222:0:5855:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788940271.802278:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1788940271.802321:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1788940271.802361:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1788940271.802376:0:5855:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1788940271.802495:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1788940271.802503:0:5855:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788940271.802569:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1788940271.806275:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1788940271.806325:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1788940271.806341:0:5855:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1788940271.806545:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1788940271.806556:0:5855:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1788940271.808509:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1788940271.808610:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1788940271.808843:0:5855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1788940271.814010:0:5855:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1788940271.814022:0:5855:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1788940271.814884:0:5878:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1788940271.824174:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1788940271.824209:0:5855:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.114@tcp for mdt 20000000:01000000:3.0:1788940271.824212:0:5855:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.114@tcp (null) (null) (null) 00000040:00080000:3.0:1788940271.824254:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1788940271.824262:0:5855:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788940271.824295:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1788940271.824303:0:5855:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.114@tcp (null) (null) 00000040:00080000:3.0:1788940271.824350:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1788940271.824361:0:5855:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1788940271.824394:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1788940271.824427:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1788940271.825023:0:5855:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788940271.825027:0:5855:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788940271.825047:0:5855:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1788940271.825054:0:5855:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1788940271.832266:0:5879:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:3.0:1788940271.832558:0:5855:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1788940271.862505:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1788940271.862624:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:3.0:1788940271.862702:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:3.0:1788940271.862723:0:5855:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788940271.862725:0:5855:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788940271.862729:0:5855:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788940271.862741:0:5855:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788940271.862744:0:5855:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788940271.862781:0:5855:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788940271.862784:0:5855:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788940271.863538:0:5880:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1788940271.879696:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1788940271.879752:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1788940271.879787:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:0.0:1788940271.879800:0:5855:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788940271.879836:0:5855:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788940271.881144:0:5881:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:0.0:1788940271.891089:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:0.0:1788940271.891142:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:0.0:1788940271.891427:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 00000020:00000080:0.0:1788940271.891446:0:5855:0:(obd_config.c:1571:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788940271.891448:0:5855:0:(obd_config.c:1636:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:0.0:1788940271.891456:0:5855:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788940271.891488:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000051335490/0x27a633fcdd4a7c9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940271.891505:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000051335490/0x27a633fcdd4a7c9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940271.891544:0:5855:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000051335490/0x27a633fcdd4a7c9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940271.891553:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000051335490/0x27a633fcdd4a7c9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940271.891559:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000051335490/0x27a633fcdd4a7c9 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940271.891565:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000051335490/0x27a633fcdd4a7c9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940271.891571:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000051335490 already unused, calling callback (000000006d13ef28) 00010000:00010000:0.0:1788940271.891573:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000051335490/0x27a633fcdd4a7c9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940271.891593:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000051335490/0x27a633fcdd4a7c9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940271.891624:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000051335490/0x27a633fcdd4a7c9 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940271.891631:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000051335490/0x27a633fcdd4a7c9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940271.891637:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000051335490/0x27a633fcdd4a7c9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788940271.891654:0:5855:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00010000:00010000:3.0:1788940272.133534:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940272.395744:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bc11af96 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+5:5841:x1875839738183936:12345-0@lo:253: Request processed in 617139us (617790us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940272.395764:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788940272.396167:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ceb60795 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5841:1875839738183936:0@lo:253: 10000000:01000000:0.0:1788940272.396182:0:5841:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788940272.396185:0:5841:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788940272.396187:0:5841:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788940272.396188:0:5841:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788940272.396189:0:5841:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1788940272.396190:0:5841:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788940272.396192:0:5841:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788940272.396193:0:5841:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788940272.396194:0:5841:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788940272.396196:0:5841:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788940272.396197:0:5841:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788940272.396199:0:5841:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788940272.396217:0:5841:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000c0d78060 from lustre-MDT0000 10000000:01000000:0.0:1788940272.396494:0:5841:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788940272.396499:0:5841:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788940272.396503:0:5841:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff89f1982e0000 10000000:01000000:0.0:1788940272.396506:0:5841:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788940272.396515:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff89f1982e0000 from 1 10000000:01000000:0.0:1788940272.396547:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788940272.396587:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: 0000000051335490/0x27a633fcdd4a7d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940272.396617:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: 0000000051335490/0x27a633fcdd4a7d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940272.396634:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: 0000000051335490/0x27a633fcdd4a7d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940272.396655:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008e46696e pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5841:1875839738184064:0@lo:101: 00000100:00100000:0.0:1788940272.396710:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940272.396759:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set 00000000dc618ac4 going to sleep for 11 seconds 00000100:00100000:1.0:1788940272.397040:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738184064 00000100:00100000:1.0:1788940272.397048:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738184064 00000100:00100000:1.0:1788940272.397088:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788940272.397095:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c1eb8db8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+5:5841:x1875839738184064:12345-0@lo:101: 00010000:00010000:1.0:1788940272.397108:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940272.397121:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000023d3f7b/0x27a633fcdd4a7d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4a7d0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940272.397252:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000023d3f7b/0x27a633fcdd4a7d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4a7d0 expref: 6 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940272.397263:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000023d3f7b/0x27a633fcdd4a7d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4a7d0 expref: 6 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940272.397272:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000023d3f7b, rc 0) 00000100:00100000:1.0:1788940272.397318:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c1eb8db8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+6:5841:x1875839738184064:12345-0@lo:101: Request processed in 224us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940272.397325:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788940272.397547:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008e46696e pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5841:1875839738184064:0@lo:101: 00010000:00010000:0.0:1788940272.397561:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: 0000000051335490/0x27a633fcdd4a7d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4a7d7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940272.397569:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: 0000000051335490/0x27a633fcdd4a7d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4a7d7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940272.398085:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008e46696e pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5841:1875839738184192:0@lo:501: 00000100:00100000:0.0:1788940272.398118:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940272.398197:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set 00000000dc618ac4 going to sleep for 11 seconds 00000100:00100000:2.0:1788940272.402685:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738184192 00000100:00100000:2.0:1788940272.402703:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738184192 00000100:00100000:0.0:1788940272.407767:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788940272.407782:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002871459a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+6:5841:x1875839738184192:12345-0@lo:501: 00000100:00100000:0.0:1788940272.408085:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002871459a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+6:5841:x1875839738184192:12345-0@lo:501: Request processed in 305us (9966us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788940272.408093:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788940272.408360:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008e46696e pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5841:1875839738184192:0@lo:501: 10000000:01000000:3.0:1788940272.408399:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788940272.408414:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: 0000000051335490/0x27a633fcdd4a7d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4a7d7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940272.408424:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: 0000000051335490/0x27a633fcdd4a7d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4a7d7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940272.408433:0:5841:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff89f188f09000 10000000:01000000:3.0:1788940272.408438:0:5841:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788940272.408443:0:5841:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff89f188f09000 10000000:01000000:3.0:1788940272.408445:0:5841:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788940272.408449:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff89f188f09000 from 1 10000000:01000000:3.0:1788940272.408451:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788940272.408507:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: 000000009d7ce0a0/0x27a633fcdd4a7de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940272.408516:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: 000000009d7ce0a0/0x27a633fcdd4a7de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940272.408541:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: 000000009d7ce0a0/0x27a633fcdd4a7de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940272.408558:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c5db4748 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5841:1875839738184320:0@lo:101: 00000100:00100000:3.0:1788940272.408603:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940272.408652:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set 000000002f9df4e9 going to sleep for 11 seconds 00000100:00100000:3.0:1788940272.408672:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738184320 00000100:00100000:3.0:1788940272.408678:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738184320 00000100:00100000:3.0:1788940272.408717:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788940272.408723:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000043f79437 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+6:5841:x1875839738184320:12345-0@lo:101: 00010000:00010000:3.0:1788940272.408731:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940272.408743:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006a57577d/0x27a633fcdd4a7e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4a7de expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940272.408762:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006a57577d/0x27a633fcdd4a7e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4a7de expref: 7 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940272.408771:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006a57577d/0x27a633fcdd4a7e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4a7de expref: 7 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940272.408779:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006a57577d, rc 0) 00000100:00100000:3.0:1788940272.408805:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000043f79437 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+7:5841:x1875839738184320:12345-0@lo:101: Request processed in 83us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940272.408811:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788940272.408845:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c5db4748 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5841:1875839738184320:0@lo:101: 00010000:00010000:3.0:1788940272.408856:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: 000000009d7ce0a0/0x27a633fcdd4a7de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4a7e5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940272.408863:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: 000000009d7ce0a0/0x27a633fcdd4a7de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4a7e5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940272.408874:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788940272.408877:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: 000000009d7ce0a0/0x27a633fcdd4a7de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4a7e5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940272.408882:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: 000000009d7ce0a0/0x27a633fcdd4a7de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4a7e5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940272.408888:0:5841:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788940272.408891:0:5841:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788940272.408895:0:5841:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff89f188f09000 10000000:01000000:3.0:1788940272.408897:0:5841:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788940272.408899:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788940272.408901:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788940272.408912:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: 000000002a2169aa/0x27a633fcdd4a7ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940272.408918:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: 000000002a2169aa/0x27a633fcdd4a7ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940272.408924:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: 000000002a2169aa/0x27a633fcdd4a7ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940272.408933:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c5db4748 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5841:1875839738184448:0@lo:101: 00000100:00100000:3.0:1788940272.408959:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940272.408970:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set 000000002f9df4e9 going to sleep for 11 seconds 00000100:00100000:3.0:1788940272.408981:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738184448 00000100:00100000:3.0:1788940272.408984:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738184448 00000100:00100000:3.0:1788940272.408998:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788940272.409002:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aa767b11 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+7:5841:x1875839738184448:12345-0@lo:101: 00010000:00010000:3.0:1788940272.409008:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940272.409014:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007442b50f/0x27a633fcdd4a7f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4a7ec expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940272.409025:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007442b50f/0x27a633fcdd4a7f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4a7ec expref: 8 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940272.409031:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007442b50f/0x27a633fcdd4a7f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4a7ec expref: 8 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940272.409038:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007442b50f, rc 0) 00000100:00100000:3.0:1788940272.409061:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aa767b11 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+8:5841:x1875839738184448:12345-0@lo:101: Request processed in 58us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940272.409066:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788940272.409089:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c5db4748 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5841:1875839738184448:0@lo:101: 00010000:00010000:3.0:1788940272.409097:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: 000000002a2169aa/0x27a633fcdd4a7ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4a7f3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940272.409104:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: 000000002a2169aa/0x27a633fcdd4a7ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4a7f3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940272.409317:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c5db4748 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5841:1875839738184576:0@lo:501: 00000100:00100000:3.0:1788940272.409347:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940272.409359:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set 000000002f9df4e9 going to sleep for 11 seconds 00000100:00100000:3.0:1788940272.409370:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738184576 00000100:00100000:3.0:1788940272.409373:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738184576 00000100:00100000:3.0:1788940272.409388:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788940272.409392:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007ffc66af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+8:5841:x1875839738184576:12345-0@lo:501: 00000100:00100000:3.0:1788940272.409598:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007ffc66af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+9:5841:x1875839738184576:12345-0@lo:501: Request processed in 205us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940272.409604:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788940272.409634:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c5db4748 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5841:1875839738184576:0@lo:501: 00000100:00100000:3.0:1788940272.409657:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c5db4748 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5841:1875839738184704:0@lo:503: 00000100:00100000:3.0:1788940272.409688:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940272.409706:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set 000000002f9df4e9 going to sleep for 11 seconds 00000100:00100000:3.0:1788940272.409717:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738184704 00000100:00100000:3.0:1788940272.409720:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738184704 00000100:00100000:3.0:1788940272.409735:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788940272.409739:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e42da9c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+9:5841:x1875839738184704:12345-0@lo:503: 00000100:00100000:3.0:1788940272.409863:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e42da9c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+9:5841:x1875839738184704:12345-0@lo:503: Request processed in 124us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940272.409869:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788940272.409900:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c5db4748 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5841:1875839738184704:0@lo:503: 00000100:00100000:2.0:1788940272.412941:0:5884:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001d185151 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5884:1875839738184832:0@lo:502: 00000100:00100000:2.0:1788940272.413032:0:5884:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940272.413070:0:5884:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d26decd7 going to sleep for 11 seconds 00000100:00100000:0.0:1788940272.413663:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738184832 00000100:00100000:0.0:1788940272.413675:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738184832 00000100:00100000:0.0:1788940272.413743:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788940272.413751:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d9cbe624 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+9:5884:x1875839738184832:12345-0@lo:502: 00000100:00100000:0.0:1788940272.414230:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d9cbe624 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+9:5884:x1875839738184832:12345-0@lo:502: Request processed in 478us (1197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940272.414238:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788940272.414296:0:5884:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001d185151 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5884:1875839738184832:0@lo:502: 00000020:01000000:0.0:1788940272.414324:0:5884:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788940272.414335:0:5884:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940272.414337:0:5884:0:(obd_config.c:1662:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788940272.414342:0:5884:0:(obd_config.c:2066:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788940272.414344:0:5884:0:(obd_config.c:1571:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788940272.414356:0:5884:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000051cda7c4) 00000020:00000080:0.0:1788940272.414373:0:5884:0:(obd_config.c:786:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788940272.414377:0:5884:0:(obd_config.c:1571:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788940272.414455:0:5884:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788940272.414460:0:5884:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x27a633fcdd4a801 00000020:00000080:0.0:1788940272.414700:0:5884:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788940272.414705:0:5884:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788940272.414708:0:5884:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940272.414709:0:5884:0:(obd_config.c:1662:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788940272.414711:0:5884:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788940272.414715:0:5884:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940272.414716:0:5884:0:(obd_config.c:1662:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788940272.414719:0:5884:0:(obd_config.c:1571:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788940272.414732:0:5884:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0000 (00000000bdc768e2) 00000020:00000080:0.0:1788940272.414742:0:5884:0:(obd_config.c:786:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788940272.414746:0:5884:0:(obd_config.c:1571:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788940272.414747:0:5884:0:(obd_config.c:1615:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788940272.414750:0:5884:0:(obd_config.c:1248:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788940272.414755:0:5884:0:(obd_config.c:1571:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788940272.414793:0:5884:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c0d78060 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788940272.414807:0:5884:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDD0000 (00000000dc3abcc9) 00000020:00000080:0.0:1788940272.415254:0:5884:0:(obd_config.c:786:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788940272.415305:0:5884:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788940272.415310:0:5884:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x27a633fcdd4a816 00000020:00000080:0.0:1788940272.415396:0:5884:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788940272.415401:0:5884:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788940272.415404:0:5884:0:(genops.c:1393:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x27a633fcdd4a81d 00080000:01000000:0.0:1788940272.415408:0:5884:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788940272.415412:0:5884:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x27a633fcdd4a824 00080000:10000000:1.0:1788940272.423941:0:5884:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:1.0:1788940272.424256:0:5884:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1788940272.433786:0:5884:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1788940272.642843:0:5884:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1788940272.643186:0:5884:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1788940272.676499:0:5884:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1788940272.676853:0:5884:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788940272.746288:0:5884:0:(genops.c:415:class_newdev()) Allocate new device lustre-QMT0000 (00000000fa1c609e) 00000020:00000080:2.0:1788940272.746311:0:5884:0:(obd_config.c:786:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788940272.746379:0:5884:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788940272.746387:0:5884:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x27a633fcdd4a832 00000020:00000080:2.0:1788940272.752745:0:5884:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1788940272.753931:0:5884:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788940272.860805:0:5884:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788940272.914506:0:5884:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788940273.030375:0:5884:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788940273.147409:0:5884:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00010000:00010000:1.0:1788940273.198601:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:1.0:1788940273.304988:0:5884:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:1.0:1788940273.484907:0:5884:0:(genops.c:1393:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x27a633fcdd4a839 00000020:00000080:1.0:1788940273.486754:0:5884:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788940273.486778:0:5884:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788940273.486786:0:5884:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940273.486788:0:5884:0:(obd_config.c:1662:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788940273.486792:0:5884:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788940273.486797:0:5884:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940273.486799:0:5884:0:(obd_config.c:1662:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788940273.486803:0:5884:0:(obd_config.c:1571:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788940273.486841:0:5884:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788940273.486854:0:5884:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788940273.486857:0:5884:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940273.486858:0:5884:0:(obd_config.c:1662:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1788940273.486860:0:5884:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788940273.486862:0:5884:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940273.486864:0:5884:0:(obd_config.c:1662:class_process_config()) marker 10 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788940273.486866:0:5884:0:(obd_config.c:1571:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788940273.486868:0:5884:0:(obd_config.c:1636:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788940273.486946:0:5884:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005d552ce5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5884:1875839738184960:0@lo:502: 00000100:00100000:1.0:1788940273.487021:0:5884:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940273.487347:0:5884:0:(client.c:2716:ptlrpc_set_wait()) set 000000000552d4db going to sleep for 11 seconds 00000100:00100000:2.0:1788940273.495151:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738184960 00000100:00100000:2.0:1788940273.495169:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738184960 00000100:00100000:2.0:1788940273.495236:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788940273.495246:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000080f9f08a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+9:5884:x1875839738184960:12345-0@lo:502: 00000100:00100000:2.0:1788940273.495716:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000080f9f08a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+9:5884:x1875839738184960:12345-0@lo:502: Request processed in 470us (8695us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940273.495724:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788940273.496051:0:5884:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005d552ce5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5884:1875839738184960:0@lo:502: 00000020:01000000:1.0:1788940273.496085:0:5884:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788940273.496092:0:5884:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940273.496095:0:5884:0:(obd_config.c:1662:class_process_config()) marker 10 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788940273.496105:0:5884:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1788940273.496647:0:5841:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1788940273.496669:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788940273.496684:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: 000000002a2169aa/0x27a633fcdd4a7ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4a7f3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940273.496695:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: 000000002a2169aa/0x27a633fcdd4a7ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4a7f3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940273.496704:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff89f188f09000 from 1 10000000:01000000:2.0:1788940273.496707:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788940273.496743:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: 000000006a32593d/0x27a633fcdd4a840 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940273.496750:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: 000000006a32593d/0x27a633fcdd4a840 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940273.496759:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: 000000006a32593d/0x27a633fcdd4a840 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940273.496798:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000005ca11fe pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5841:1875839738185088:0@lo:101: 00000100:00100000:2.0:1788940273.496842:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940273.496894:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set 000000003cb6a16b going to sleep for 11 seconds 00000100:00100000:3.0:1788940273.497083:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738185088 00000100:00100000:3.0:1788940273.497089:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738185088 00000100:00100000:3.0:1788940273.497142:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788940273.497150:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000112565ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+9:5841:x1875839738185088:12345-0@lo:101: 00010000:00010000:3.0:1788940273.497159:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940273.497175:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000058fc74b4/0x27a633fcdd4a847 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4a840 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940273.497195:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000058fc74b4/0x27a633fcdd4a847 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4a840 expref: 10 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940273.497204:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000058fc74b4/0x27a633fcdd4a847 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4a840 expref: 10 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940273.497212:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000058fc74b4, rc 0) 00000100:00100000:3.0:1788940273.497243:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000112565ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+10:5841:x1875839738185088:12345-0@lo:101: Request processed in 94us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940273.497249:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788940273.497396:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000005ca11fe pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5841:1875839738185088:0@lo:101: 00010000:00010000:2.0:1788940273.497408:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: 000000006a32593d/0x27a633fcdd4a840 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4a847 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940273.497416:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: 000000006a32593d/0x27a633fcdd4a840 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4a847 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940273.498053:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000005ca11fe pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5841:1875839738185216:0@lo:256: 00000100:00100000:2.0:1788940273.498089:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940273.498119:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set 000000003cb6a16b going to sleep for 11 seconds 00000100:00100000:3.0:1788940273.498410:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738185216 00000100:00100000:3.0:1788940273.498416:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738185216 00000100:00100000:3.0:1788940273.498447:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788940273.498454:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000302e9686 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+10:5841:x1875839738185216:12345-0@lo:256: 20000000:01000000:3.0:1788940273.498477:0:5853:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788940273.498482:0:5853:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788940273.498576:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000302e9686 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+10:5841:x1875839738185216:12345-0@lo:256: Request processed in 123us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940273.498584:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788940273.498662:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000005ca11fe pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5841:1875839738185216:0@lo:256: 10000000:01000000:0.0:1788940273.499222:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788940273.499238:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: 000000006a32593d/0x27a633fcdd4a840 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4a847 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940273.499248:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: 000000006a32593d/0x27a633fcdd4a840 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4a847 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940273.499256:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89f188f09000 from 1 10000000:01000000:0.0:1788940273.499258:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788940273.499284:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: 00000000e5942370/0x27a633fcdd4a84e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940273.499290:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: 00000000e5942370/0x27a633fcdd4a84e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940273.499298:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: 00000000e5942370/0x27a633fcdd4a84e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940273.499311:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002201ca25 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5841:1875839738185344:0@lo:101: 00000100:00100000:0.0:1788940273.499343:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940273.499384:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set 00000000914ed869 going to sleep for 11 seconds 00000100:00100000:3.0:1788940273.499691:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738185344 00000100:00100000:3.0:1788940273.499698:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738185344 00000100:00100000:3.0:1788940273.499737:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788940273.499744:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000007801f43 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+10:5841:x1875839738185344:12345-0@lo:101: 00010000:00010000:3.0:1788940273.499752:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940273.499763:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000263f8369/0x27a633fcdd4a855 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4a84e expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940273.499807:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000263f8369/0x27a633fcdd4a855 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4a84e expref: 11 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940273.499815:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000263f8369/0x27a633fcdd4a855 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4a84e expref: 11 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940273.499823:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000263f8369, rc 0) 00000100:00100000:3.0:1788940273.499855:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000007801f43 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+11:5841:x1875839738185344:12345-0@lo:101: Request processed in 112us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940273.499861:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788940273.499896:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002201ca25 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5841:1875839738185344:0@lo:101: 00010000:00010000:3.0:1788940273.499917:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: 00000000e5942370/0x27a633fcdd4a84e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4a855 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940273.499924:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: 00000000e5942370/0x27a633fcdd4a84e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4a855 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940273.499974:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c5db4748 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5841:1875839738185472:0@lo:501: 00000100:00100000:3.0:1788940273.499996:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940273.500012:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set 000000005fb130f2 going to sleep for 11 seconds 00000100:00100000:3.0:1788940273.500023:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738185472 00000100:00100000:3.0:1788940273.500026:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738185472 00000100:00100000:3.0:1788940273.500041:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788940273.500045:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006385c14b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+11:5841:x1875839738185472:12345-0@lo:501: 00000100:00100000:3.0:1788940273.500886:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006385c14b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+11:5841:x1875839738185472:12345-0@lo:501: Request processed in 839us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940273.500894:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788940273.501075:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c5db4748 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5841:1875839738185472:0@lo:501: 00000100:00100000:3.0:1788940273.501233:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c5db4748 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5841:1875839738185600:0@lo:503: 00000100:00100000:3.0:1788940273.501270:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940273.501285:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set 000000005fb130f2 going to sleep for 11 seconds 00000100:00100000:3.0:1788940273.501300:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738185600 00000100:00100000:3.0:1788940273.501304:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738185600 00000100:00100000:3.0:1788940273.501325:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788940273.501330:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000215bf7cc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+11:5841:x1875839738185600:12345-0@lo:503: 00000040:00080000:3.0:1788940273.501369:0:5855:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788940273.501401:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000215bf7cc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+11:5841:x1875839738185600:12345-0@lo:503: Request processed in 71us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940273.501407:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788940273.501439:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c5db4748 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5841:1875839738185600:0@lo:503: 00000040:00080000:3.0:1788940273.515346:0:5888:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1788940273.515590:0:5841:0:(obd_config.c:2244:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1788940273.515609:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788940273.515623:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: 00000000e5942370/0x27a633fcdd4a84e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4a855 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940273.515636:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: 00000000e5942370/0x27a633fcdd4a84e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4a855 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940273.515676:0:5841:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788940273.515679:0:5841:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff89f188f09000 10000000:01000000:1.0:1788940273.515681:0:5841:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff89f188f09000 10000000:01000000:1.0:1788940273.515686:0:5841:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788940273.515691:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff89f188f09000 from 1 10000000:01000000:1.0:1788940273.515694:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788940273.515732:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: 0000000058a522cf/0x27a633fcdd4a85c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940273.515740:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: 0000000058a522cf/0x27a633fcdd4a85c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940273.515751:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: 0000000058a522cf/0x27a633fcdd4a85c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940273.515785:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005d552ce5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5841:1875839738185728:0@lo:101: 00000100:00100000:1.0:1788940273.515850:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940273.515923:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f6c28ab2 going to sleep for 11 seconds 00000100:00100000:3.0:1788940273.516187:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738185728 00000100:00100000:3.0:1788940273.516195:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738185728 00000100:00100000:3.0:1788940273.516247:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788940273.516256:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000936f71c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+11:5841:x1875839738185728:12345-0@lo:101: 00010000:00010000:3.0:1788940273.516268:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940273.516280:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d6de87ae/0x27a633fcdd4a863 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4a85c expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940273.516302:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d6de87ae/0x27a633fcdd4a863 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4a85c expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940273.516311:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d6de87ae/0x27a633fcdd4a863 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4a85c expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940273.516330:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d6de87ae, rc 0) 00000100:00100000:3.0:1788940273.516444:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000936f71c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+12:5841:x1875839738185728:12345-0@lo:101: Request processed in 189us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940273.516452:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788940273.517419:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005d552ce5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5841:1875839738185728:0@lo:101: 00010000:00010000:2.0:1788940273.517438:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: 0000000058a522cf/0x27a633fcdd4a85c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4a863 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940273.517448:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: 0000000058a522cf/0x27a633fcdd4a85c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4a863 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940273.517649:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000443acb1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5841:1875839738185856:0@lo:501: 00000100:00100000:0.0:1788940273.517761:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940273.517800:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ca2fb4f5 going to sleep for 11 seconds 00000100:00100000:2.0:1788940273.517907:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738185856 00000100:00100000:2.0:1788940273.517977:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738185856 00000100:00100000:2.0:1788940273.518015:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788940273.518022:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000be9cf400 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+12:5841:x1875839738185856:12345-0@lo:501: 00000100:00100000:2.0:1788940273.518478:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000be9cf400 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+12:5841:x1875839738185856:12345-0@lo:501: Request processed in 455us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940273.518492:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788940273.518664:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000443acb1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5841:1875839738185856:0@lo:501: 00000100:00100000:0.0:1788940273.518695:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004597fec8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5841:1875839738185984:0@lo:503: 00000100:00100000:0.0:1788940273.518730:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940273.518756:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set 000000002b55e126 going to sleep for 11 seconds 00000100:00100000:3.0:1788940273.518845:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738185984 00000100:00100000:3.0:1788940273.518849:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738185984 00000100:00100000:3.0:1788940273.518878:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788940273.518883:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000042a4c7d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+12:5841:x1875839738185984:12345-0@lo:503: 00000100:00100000:3.0:1788940273.519390:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000042a4c7d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+12:5841:x1875839738185984:12345-0@lo:503: Request processed in 506us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940273.519397:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788940273.519474:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004597fec8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5841:1875839738185984:0@lo:503: 00000100:00100000:0.0:1788940273.526852:0:5889:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004b5f0f36 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5889:1875839738186112:0@lo:502: 00000100:00100000:0.0:1788940273.526962:0:5889:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940273.527008:0:5889:0:(client.c:2716:ptlrpc_set_wait()) set 00000000711351e8 going to sleep for 11 seconds 00000100:00100000:2.0:1788940273.527498:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738186112 00000100:00100000:2.0:1788940273.527507:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738186112 00000100:00100000:2.0:1788940273.527581:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788940273.527590:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ace282e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+12:5889:x1875839738186112:12345-0@lo:502: 00000100:00100000:2.0:1788940273.527872:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ace282e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+12:5889:x1875839738186112:12345-0@lo:502: Request processed in 282us (910us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940273.527879:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788940273.528315:0:5889:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004b5f0f36 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5889:1875839738186112:0@lo:502: 00000020:01000004:0.0:1788940273.528374:0:5889:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788940273.528386:0:5889:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000dd5d2b37) 00000020:00000080:0.0:1788940273.528403:0:5889:0:(obd_config.c:786:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1788940273.528491:0:5889:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c0d78060 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788940273.528495:0:5889:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000c0d78060 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788940273.528497:0:5889:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000c0d78060 4 00010000:00080000:0.0:1788940273.528555:0:5889:0:(ldlm_lib.c:102:import_set_conn()) imp 000000005c702715@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.114@tcp at head 00010000:00010000:0.0:1788940273.531734:0:5889:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1788940273.531903:0:5889:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788940273.531945:0:5889:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788940273.531956:0:5889:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x27a633fcdd4a871 00000100:00080000:0.0:1788940273.531966:0:5889:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788940273.531970:0:5889:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000005c702715 using connection 192.168.202.114@tcp/0@lo 00000100:00100000:0.0:1788940273.532005:0:5889:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000004b5f0f36 x1875839738186240/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788940273.532027:0:5889:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788940273.534120:0:5889:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005943b576 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5889:1875839738186368:0@lo:502: 00000100:00100000:1.0:1788940273.534251:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004b5f0f36 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875839738186240:0@lo:38: 00000100:00100000:1.0:1788940273.534321:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940273.534402:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738186240 00000100:00100000:1.0:1788940273.534410:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738186240 00000100:00100000:1.0:1788940273.534441:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788940273.534448:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e56fe138 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1875839738186240:12345-0@lo:38: 00000100:00100000:1.0:1788940273.534508:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e56fe138 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1875839738186240:12345-0@lo:38: Request processed in 58us (186us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788940273.534515:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788940273.534562:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788940273.534569:0:3304:0:(import.c:65:import_set_state_nolock()) 000000005c702715 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788940273.534573:0:3304:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788940273.534576:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004b5f0f36 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875839738186240:0@lo:38: 00000100:00100000:2.0:1788940273.535014:0:5889:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940273.537491:0:5889:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ca2fb4f5 going to sleep for 11 seconds 00000100:00100000:3.0:1788940273.542216:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738186368 00000100:00100000:3.0:1788940273.542232:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738186368 00000100:00100000:2.0:1788940273.542446:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788940273.542467:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006b667b7e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+12:5889:x1875839738186368:12345-0@lo:502: 00000100:00100000:2.0:1788940273.542788:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006b667b7e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+12:5889:x1875839738186368:12345-0@lo:502: Request processed in 333us (7773us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940273.542797:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788940273.542944:0:5889:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005943b576 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5889:1875839738186368:0@lo:502: 00000040:00080000:1.0:1788940273.542979:0:5889:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1788940273.543347:0:5841:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1788940273.543366:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788940273.543385:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: 0000000058a522cf/0x27a633fcdd4a85c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4a863 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940273.543396:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: 0000000058a522cf/0x27a633fcdd4a85c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4a863 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788940273.543440:0:5841:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788940273.543442:0:5841:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788940273.543444:0:5841:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788940273.543448:0:5841:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788940273.543450:0:5841:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788940273.543451:0:5841:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788940273.543452:0:5841:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788940273.543454:0:5841:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788940273.543492:0:5841:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788940273.543494:0:5841:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788940273.543495:0:5841:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788940273.543496:0:5841:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788940273.543500:0:5841:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1788940273.543503:0:5841:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788940273.543504:0:5841:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788940273.543505:0:5841:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788940273.543506:0:5841:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788940273.543507:0:5841:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788940273.543508:0:5841:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788940273.543508:0:5841:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788940273.543509:0:5841:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788940273.543510:0:5841:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788940273.543511:0:5841:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788940273.543511:0:5841:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788940273.543512:0:5841:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788940273.543566:0:5841:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788940273.543580:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000027ffc059 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5841:1875839738186496:0@lo:253: 00000100:00100000:2.0:1788940273.543622:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940273.543650:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set 0000000004f20742 going to sleep for 11 seconds 00000100:00100000:3.0:1788940273.545057:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738186496 00000100:00100000:3.0:1788940273.545068:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738186496 00000100:00100000:3.0:1788940273.545118:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788940273.545136:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000209f458c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+12:5841:x1875839738186496:12345-0@lo:253: 20000000:01000000:3.0:1788940273.545161:0:5854:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788940273.545175:0:5854:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788940273.647729:0:5854:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788940273.647749:0:5854:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788940273.648452:0:5876:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788940273.648468:0:5876:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788940273.648489:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ea1a10a6/0x27a633fcdd4a878 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940273.648508:0:5876:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000058fc74b4/0x27a633fcdd4a847 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4a840 expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940273.648548:0:5876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000ea1a10a6/0x27a633fcdd4a878 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940273.648626:0:5876:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000058fc74b4/0x27a633fcdd4a847 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27a633fcdd4a840 expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940273.648642:0:5876:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000058fc74b4/0x27a633fcdd4a847 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27a633fcdd4a840 expref: 12 pid: 5854 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940273.648657:0:5876:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002d7c5046 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5876:1875839738186624:0@lo:104: 00000100:00100000:1.0:1788940273.648725:0:5876:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940273.648788:0:5876:0:(client.c:2716:ptlrpc_set_wait()) set 000000003a4af225 going to sleep for 11 seconds 00000100:00100000:3.0:1788940273.649383:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738186624 00000100:00100000:3.0:1788940273.649393:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738186624 00000100:00100000:3.0:1788940273.649438:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788940273.649446:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c711e4a5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+3:5876:x1875839738186624:12345-0@lo:104: 00010000:00010000:3.0:1788940273.649470:0:5843:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: 000000006a32593d/0x27a633fcdd4a840 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4a847 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940273.649574:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788940273.649586:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c711e4a5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+3:5876:x1875839738186624:12345-0@lo:104: Request processed in 140us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940273.649594:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788940273.649615:0:5848:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940273.649620:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: 000000006a32593d/0x27a633fcdd4a840 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4a847 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940273.649627:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006a32593d already unused, calling callback (000000002075d841) 10000000:00010000:3.0:1788940273.649630:0:5848:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: 000000006a32593d/0x27a633fcdd4a840 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x27a633fcdd4a847 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940273.649638:0:5848:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: 000000006a32593d/0x27a633fcdd4a840 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x27a633fcdd4a847 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788940273.649645:0:5848:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: 000000006a32593d/0x27a633fcdd4a840 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x27a633fcdd4a847 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940273.649650:0:5848:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788940273.649676:0:5848:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: 000000006a32593d/0x27a633fcdd4a840 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4a847 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940273.649682:0:5848:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788940273.649694:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: 000000006a32593d/0x27a633fcdd4a840 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4a847 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940273.649700:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: 000000006a32593d/0x27a633fcdd4a840 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4a847 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940273.649714:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940273.649716:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940273.649717:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940273.649827:0:5876:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002d7c5046 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5876:1875839738186624:0@lo:104: 00010000:00010000:2.0:1788940273.649858:0:5876:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000ea1a10a6/0x27a633fcdd4a878 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940273.651142:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c5db4748 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3306:1875839738186752:0@lo:103: 00000100:00100000:0.0:1788940273.651191:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940273.651565:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738186752 00000100:00100000:1.0:1788940273.651574:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738186752 00010000:00010000:1.0:1788940273.651597:0:5845:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000058fc74b4/0x27a633fcdd4a847 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4a840 expref: 13 pid: 5854 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940273.651680:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788940273.651688:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000649b22c6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+13:3306:x1875839738186752:12345-0@lo:103: 00010000:00010000:1.0:1788940273.651702:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940273.651706:0:5845:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000058fc74b4/0x27a633fcdd4a847 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4a840 expref: 13 pid: 5854 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940273.651716:0:5845:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000058fc74b4/0x27a633fcdd4a847 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27a633fcdd4a840 expref: 13 pid: 5854 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940273.651731:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000058fc74b4/0x27a633fcdd4a847 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27a633fcdd4a840 expref: 13 pid: 5854 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940273.651746:0:5845:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000ea1a10a6/0x27a633fcdd4a878 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940273.651763:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ea1a10a6/0x27a633fcdd4a878 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788940273.651776:0:5845:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003308607s 00010000:00010000:1.0:1788940273.651780:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ea1a10a6/0x27a633fcdd4a878 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940273.651786:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ea1a10a6/0x27a633fcdd4a878 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940273.651792:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ea1a10a6/0x27a633fcdd4a878 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940273.651798:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ea1a10a6/0x27a633fcdd4a878 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940273.651804:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ea1a10a6 already unused, calling callback (000000006d13ef28) 00010000:00010000:1.0:1788940273.651807:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ea1a10a6/0x27a633fcdd4a878 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940273.651814:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ea1a10a6/0x27a633fcdd4a878 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940273.651835:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ea1a10a6/0x27a633fcdd4a878 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940273.651851:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940273.651893:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000649b22c6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+12:3306:x1875839738186752:12345-0@lo:103: Request processed in 206us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940273.651899:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788940273.652066:0:5876:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000ea1a10a6/0x27a633fcdd4a878 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940273.652074:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ea1a10a6/0x27a633fcdd4a878 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940273.652079:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ea1a10a6/0x27a633fcdd4a878 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940273.666402:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c5db4748 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3306:1875839738186752:0@lo:103: 00000100:00100000:3.0:1788940273.674093:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000209f458c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+11:5841:x1875839738186496:12345-0@lo:253: Request processed in 128951us (130463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940273.674152:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788940273.674762:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000027ffc059 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5841:1875839738186496:0@lo:253: 10000000:01000000:2.0:1788940273.674778:0:5841:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788940273.674781:0:5841:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788940273.674783:0:5841:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788940273.674799:0:5841:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788940273.674801:0:5841:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788940273.674802:0:5841:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788940273.674803:0:5841:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788940273.674805:0:5841:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788940273.674806:0:5841:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788940273.674807:0:5841:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788940273.674809:0:5841:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788940273.674810:0:5841:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788940273.674811:0:5841:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788940273.674826:0:5841:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788940273.696005:0:5841:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1788940273.697364:0:5841:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788940273.697630:0:5841:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1788940273.697784:0:5841:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788940273.697954:0:5841:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1788940273.698113:0:5841:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1788940273.700801:0:5841:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1788940273.700977:0:5841:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1788940273.701167:0:5841:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1788940273.701318:0:5841:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1788940273.701549:0:5841:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1788940273.701708:0:5841:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:2.0:1788940273.889063:0:5841:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1788940273.991494:0:5841:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1788940273.991611:0:5894:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1788940273.991617:0:5894:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1788940273.992007:0:5895:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788940273.999121:0:5841:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788940273.999292:0:5841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788940273.999805:0:5841:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788940273.999812:0:5841:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788940273.999946:0:5841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788940274.019685:0:5841:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788940274.022816:0:5841:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788940274.023380:0:5841:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1788940274.034653:0:5841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1788940274.035157:0:5841:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1788940274.036343:0:5841:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1788940274.036486:0:5841:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1788940274.036649:0:5841:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1788940274.036800:0:5841:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1788940274.036942:0:5841:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1788940274.037088:0:5841:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1788940274.037231:0:5841:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1788940274.037363:0:5841:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1788940274.056512:0:5841:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1788940274.056789:0:5841:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1788940274.057353:0:5841:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1788940274.057565:0:5841:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1788940274.057696:0:5841:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1788940274.057833:0:5841:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1788940274.057980:0:5841:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1788940274.058393:0:5841:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1788940274.063125:0:5841:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1788940274.063360:0:5841:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1788940274.064090:0:5841:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1788940274.064249:0:5841:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1788940274.064368:0:5841:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1788940274.064564:0:5841:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1788940274.064693:0:5841:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1788940274.064828:0:5841:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1788940274.064962:0:5841:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1788940274.065093:0:5841:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1788940274.065229:0:5841:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1788940274.065370:0:5841:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1788940274.069003:0:5841:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1788940274.069253:0:5841:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1788940274.069393:0:5841:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1788940274.069786:0:5841:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1788940274.069973:0:5841:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1788940274.102952:0:5895:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00010000:00010000:3.0:1788940274.221264:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788940274.244259:0:5841:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788940274.244292:0:5841:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff98fc41913988 00100000:10000000:2.0:1788940274.244300:0:5841:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788940274.264439:0:5841:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788940274.264471:0:5841:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.114@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788940274.264484:0:5841:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1788940274.264502:0:5841:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:2.0:1788940274.464171:0:5895:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788940274.464251:0:5895:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 1, retries 0 00000004:00080000:2.0:1788940274.464256:0:5895:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1788940275.244827:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940276.269414:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788940276.889713:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788940276.889721:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff89f188f09000 from 3 10000000:01000000:0.0:1788940276.889725:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788940276.889777:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: 00000000f2ab094e/0x27a633fcdd4a87f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940276.889789:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: 00000000f2ab094e/0x27a633fcdd4a87f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940276.889801:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: 00000000f2ab094e/0x27a633fcdd4a87f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940276.889824:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000071983a09 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738186880:0@lo:101: 00000100:00100000:0.0:1788940276.889893:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940276.890567:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fab408ef going to sleep for 11 seconds 00000100:00100000:3.0:1788940276.891704:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738186880 00000100:00100000:3.0:1788940276.891716:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738186880 00000100:00100000:3.0:1788940276.891786:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788940276.891796:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000c470692 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+11:5858:x1875839738186880:12345-0@lo:101: 00010000:00010000:3.0:1788940276.891813:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940276.891830:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000058fc74b4/0x27a633fcdd4a886 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4a87f expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940276.891859:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000058fc74b4/0x27a633fcdd4a886 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4a87f expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940276.891870:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000058fc74b4/0x27a633fcdd4a886 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4a87f expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940276.891879:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000058fc74b4, rc 0) 00000100:00100000:3.0:1788940276.891944:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000c470692 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+12:5858:x1875839738186880:12345-0@lo:101: Request processed in 150us (2050us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940276.891966:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788940276.902013:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000071983a09 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738186880:0@lo:101: 00010000:00010000:0.0:1788940276.902045:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: 00000000f2ab094e/0x27a633fcdd4a87f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4a886 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940276.902078:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: 00000000f2ab094e/0x27a633fcdd4a87f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4a886 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940276.902152:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000071983a09 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738187008:0@lo:256: 00000100:00100000:0.0:1788940276.902223:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940276.902268:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fab408ef going to sleep for 11 seconds 00000100:00100000:0.0:1788940276.902290:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738187008 00000100:00100000:0.0:1788940276.902297:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738187008 00000100:00100000:0.0:1788940276.902347:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788940276.902355:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000727a83e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+12:5858:x1875839738187008:12345-0@lo:256: 20000000:01000000:0.0:1788940276.902375:0:5854:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788940276.902390:0:5854:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788940276.902394:0:5854:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1788940276.905313:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000727a83e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+12:5858:x1875839738187008:12345-0@lo:256: Request processed in 2950us (3082us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940276.905329:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788940276.905423:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000071983a09 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738187008:0@lo:256: 10000000:01000000:0.0:1788940276.906342:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788940276.906352:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: 00000000f2ab094e/0x27a633fcdd4a87f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4a886 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940276.906363:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: 00000000f2ab094e/0x27a633fcdd4a87f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4a886 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940277.293322:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940278.319333:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788940278.764774:0:37:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788940278.764784:0:37:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788940278.764804:0:37:0:(import.c:65:import_set_state_nolock()) 000000005c702715 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788940278.764817:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000005c702715 using connection 192.168.202.114@tcp/0@lo 00000100:00100000:0.0:1788940278.764858:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000531e10df x1875839738187264/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788940278.764898:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000531e10df pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875839738187264:0@lo:38: 00000100:00100000:0.0:1788940278.764969:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940278.765108:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788940278.765117:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000071983a09 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3308:1875839738187136:0@lo:400: 00000100:00100000:3.0:1788940278.765163:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940278.765416:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738187264 00000100:00100000:2.0:1788940278.765427:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738187264 00000100:00100000:2.0:1788940278.765472:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788940278.765480:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002e5e5210 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3304:x1875839738187264:12345-0@lo:38: 00010000:00080000:2.0:1788940278.765505:0:5862:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 221 last 0 00000020:00000080:2.0:1788940278.765566:0:5862:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x27a633fcdd4a88d 00000004:00100000:2.0:1788940278.765608:0:5862:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788940278.765732:0:5862:0:(import.c:65:import_set_state_nolock()) 00000000a099955b : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788940278.765788:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002e5e5210 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875839738187264:12345-0@lo:38: Request processed in 308us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940278.765796:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788940278.766181:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738187136 00000100:00100000:0.0:1788940278.766186:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738187136 00000100:00100000:0.0:1788940278.766227:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788940278.766234:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d60647f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+12:3308:x1875839738187136:12345-0@lo:400: 00000100:00100000:0.0:1788940278.766282:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d60647f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+12:3308:x1875839738187136:12345-0@lo:400: Request processed in 49us (1119us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940278.766288:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1788940278.766338:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000531e10df x1875839738187264/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788940288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788940278.766354:0:3304:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788940278.766362:0:3304:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788940278.766367:0:3304:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788940278.766369:0:3304:0:(import.c:65:import_set_state_nolock()) 000000005c702715 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788940278.766375:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000531e10df pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875839738187264:0@lo:38: 00000100:00100000:3.0:1788940278.766515:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000071983a09 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3308:1875839738187136:0@lo:400: 00010000:00010000:1.0:1788940279.340706:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940280.499096:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940281.530503:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940282.548822:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788940283.127743:0:6138:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg214-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788940283.564853:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940283.884751:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000531e10df pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3308:1875839738187392:0@lo:400: 00000100:00100000:3.0:1788940283.884830:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940283.884923:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738187392 00000100:00100000:1.0:1788940283.884933:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738187392 00000100:00100000:1.0:1788940283.884983:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788940283.884992:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000083c0646f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+12:3308:x1875839738187392:12345-0@lo:400: 00000100:00100000:0.0:1788940283.885116:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000798b9383 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875839738187520:0@lo:400: 00000100:00100000:0.0:1788940283.885150:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940283.885257:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738187520 00000100:00100000:2.0:1788940283.885262:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738187520 00000100:00100000:2.0:1788940283.885297:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788940283.885303:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e93c0315 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875839738187520:12345-0@lo:400: 00000100:00100000:2.0:1788940283.885374:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e93c0315 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875839738187520:12345-0@lo:400: Request processed in 54us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940283.885382:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788940283.885443:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000083c0646f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+12:3308:x1875839738187392:12345-0@lo:400: Request processed in 452us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940283.885450:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1788940283.885643:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000798b9383 x1875839738187520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940299 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940283.885658:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000798b9383 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875839738187520:0@lo:400: 00000100:00100000:3.0:1788940283.885908:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000531e10df pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3308:1875839738187392:0@lo:400: 00010000:00010000:1.0:1788940284.591405:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940285.612786:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940286.640778:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940287.660805:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940288.689248:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940289.004899:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788940289.004924:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000886418e0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875839738187776:0@lo:400: 00000100:00100000:2.0:1788940289.005001:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940289.005059:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738187776 00000100:00100000:2.0:1788940289.005067:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738187776 00000100:00100000:2.0:1788940289.005126:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788940289.005135:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000010f5354c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875839738187776:12345-0@lo:400: 00000100:00100000:2.0:1788940289.005186:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000010f5354c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875839738187776:12345-0@lo:400: Request processed in 52us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940289.005193:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788940289.005233:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000886418e0 x1875839738187776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940305 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940289.005247:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000886418e0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875839738187776:0@lo:400: 00000100:00100000:0.0:1788940289.005300:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000027ffc059 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3306:1875839738187648:0@lo:400: 00000100:00100000:0.0:1788940289.005350:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940289.005829:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738187648 00000100:00100000:2.0:1788940289.005834:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738187648 00000100:00100000:2.0:1788940289.005901:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788940289.005908:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000098cf85a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+12:3306:x1875839738187648:12345-0@lo:400: 00000100:00100000:2.0:1788940289.005956:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000098cf85a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+12:3306:x1875839738187648:12345-0@lo:400: Request processed in 49us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940289.005962:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788940289.006027:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000027ffc059 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3306:1875839738187648:0@lo:400: 00010000:00010000:2.0:1788940289.725822:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940290.733020:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788940290.938998:0:6340:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd3ecb90a0 20000000:00000080:2.0:1788940290.939017:0:6340:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff89f1b53ad400 uarg=0000000000000000 20000000:01000000:2.0:1788940290.939052:0:6340:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788940290.939066:0:6340:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788940290.939071:0:6340:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788940290.939806:0:6340:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1788940290.939819:0:6340:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1788940290.945968:0:6340:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788940290.946906:0:6340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788940290.946969:0:6340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1788940290.947023:0:6340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1788940290.947041:0:6340:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788940290.947060:0:6340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000006a32593d/0x27a633fcdd4a894 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940290.947079:0:6340:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000263f8369/0x27a633fcdd4a855 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4a84e expref: 11 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940290.947088:0:6340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000006a32593d/0x27a633fcdd4a894 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940290.947200:0:6340:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000263f8369/0x27a633fcdd4a855 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27a633fcdd4a84e expref: 11 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940290.947214:0:6340:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000263f8369/0x27a633fcdd4a855 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27a633fcdd4a84e expref: 11 pid: 5855 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940290.947229:0:6340:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000886418e0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6340:1875839738187904:0@lo:104: 00000100:00100000:2.0:1788940290.947306:0:6340:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940290.947412:0:6340:0:(client.c:2716:ptlrpc_set_wait()) set 0000000085ffd618 going to sleep for 11 seconds 00000100:00100000:0.0:1788940290.947833:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738187904 00000100:00100000:0.0:1788940290.947843:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738187904 00000100:00100000:0.0:1788940290.947930:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788940290.947940:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000059ccfd04 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+3:6340:x1875839738187904:12345-0@lo:104: 00010000:00010000:0.0:1788940290.947954:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: 00000000e5942370/0x27a633fcdd4a84e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4a855 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940290.948063:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788940290.948068:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000059ccfd04 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+3:6340:x1875839738187904:12345-0@lo:104: Request processed in 131us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940290.948075:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788940290.948215:0:6340:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000886418e0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6340:1875839738187904:0@lo:104: 00010000:00010000:2.0:1788940290.948233:0:6340:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000006a32593d/0x27a633fcdd4a894 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940290.948434:0:5848:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940290.948439:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: 00000000e5942370/0x27a633fcdd4a84e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4a855 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940290.948447:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e5942370 already unused, calling callback (000000002075d841) 10000000:00010000:1.0:1788940290.948450:0:5848:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: 00000000e5942370/0x27a633fcdd4a84e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x27a633fcdd4a855 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940290.948457:0:5848:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: 00000000e5942370/0x27a633fcdd4a84e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x27a633fcdd4a855 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788940290.948464:0:5848:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: 00000000e5942370/0x27a633fcdd4a84e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x27a633fcdd4a855 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940290.948485:0:5848:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788940290.948647:0:5848:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: 00000000e5942370/0x27a633fcdd4a84e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4a855 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940290.948655:0:5848:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788940290.948678:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: 00000000e5942370/0x27a633fcdd4a84e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4a855 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940290.948685:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: 00000000e5942370/0x27a633fcdd4a84e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4a855 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940290.948703:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940290.948705:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940290.948707:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940290.948714:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788940290.948725:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e2d11802 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3307:1875839738188032:0@lo:103: 00000100:00100000:1.0:1788940290.948995:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940290.949069:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738188032 00000100:00100000:3.0:1788940290.949075:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738188032 00010000:00010000:3.0:1788940290.949094:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000263f8369/0x27a633fcdd4a855 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4a84e expref: 12 pid: 5855 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940290.949194:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788940290.949202:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000005a18ce4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+12:3307:x1875839738188032:12345-0@lo:103: 00010000:00010000:3.0:1788940290.949214:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940290.949217:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000263f8369/0x27a633fcdd4a855 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4a84e expref: 12 pid: 5855 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940290.949227:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000263f8369/0x27a633fcdd4a855 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27a633fcdd4a84e expref: 12 pid: 5855 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940290.949246:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000263f8369/0x27a633fcdd4a855 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27a633fcdd4a84e expref: 12 pid: 5855 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940290.949260:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000006a32593d/0x27a633fcdd4a894 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940290.949267:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006a32593d/0x27a633fcdd4a894 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940290.949281:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006a32593d/0x27a633fcdd4a894 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940290.949288:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006a32593d/0x27a633fcdd4a894 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940290.949302:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000006a32593d/0x27a633fcdd4a894 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940290.949308:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000006a32593d/0x27a633fcdd4a894 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940290.949313:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006a32593d already unused, calling callback (000000006d13ef28) 00010000:00010000:3.0:1788940290.949316:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000006a32593d/0x27a633fcdd4a894 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940290.949323:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000006a32593d/0x27a633fcdd4a894 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940290.949336:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000006a32593d/0x27a633fcdd4a894 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940290.949356:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940290.949388:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000005a18ce4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+11:3307:x1875839738188032:12345-0@lo:103: Request processed in 187us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940290.949394:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1788940290.949419:0:6340:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000006a32593d/0x27a633fcdd4a894 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940290.949426:0:6340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000006a32593d/0x27a633fcdd4a894 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940290.949431:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006a32593d/0x27a633fcdd4a894 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940290.951272:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e2d11802 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3307:1875839738188032:0@lo:103: 00010000:00010000:2.0:1788940291.757135:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940292.781506:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940293.806549:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940294.127045:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006c4b6ea2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3305:1875839738188160:0@lo:400: 00000100:00100000:3.0:1788940294.127113:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940294.127168:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788940294.127173:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000071e3fac3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875839738188288:0@lo:400: 00000100:00100000:3.0:1788940294.127198:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940294.133233:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738188288 00000100:00100000:2.0:1788940294.133252:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738188288 00000100:00100000:2.0:1788940294.133331:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788940294.133340:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000359377ce pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875839738188288:12345-0@lo:400: 00000100:00100000:2.0:1788940294.133434:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000359377ce pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875839738188288:12345-0@lo:400: Request processed in 96us (6235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940294.133440:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788940294.133506:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000071e3fac3 x1875839738188288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940310 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940294.133537:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000071e3fac3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875839738188288:0@lo:400: 00000100:00100000:0.0:1788940294.139323:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738188160 00000100:00100000:0.0:1788940294.139342:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738188160 00000100:00100000:0.0:1788940294.139405:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788940294.139414:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d2bafb46 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+11:3305:x1875839738188160:12345-0@lo:400: 00000100:00100000:0.0:1788940294.139502:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d2bafb46 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+11:3305:x1875839738188160:12345-0@lo:400: Request processed in 89us (12389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940294.139509:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788940294.140030:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006c4b6ea2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3305:1875839738188160:0@lo:400: 00010000:00010000:2.0:1788940294.840410:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940295.857058:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940296.879814:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940297.913805:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940298.924684:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940299.245947:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000677f4454 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3307:1875839738188416:0@lo:400: 00000100:00100000:1.0:1788940299.246016:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940299.246066:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788940299.246070:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000063004b36 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875839738188544:0@lo:400: 00000100:00100000:1.0:1788940299.246090:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940299.246115:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738188544 00000100:00100000:1.0:1788940299.246128:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738188544 00000100:00100000:1.0:1788940299.246174:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788940299.246183:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e2d11802 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875839738188544:12345-0@lo:400: 00000100:00100000:1.0:1788940299.246250:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e2d11802 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875839738188544:12345-0@lo:400: Request processed in 69us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940299.246255:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788940299.246298:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000063004b36 x1875839738188544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940315 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940299.246309:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000063004b36 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875839738188544:0@lo:400: 00000100:00100000:2.0:1788940299.246486:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738188416 00000100:00100000:2.0:1788940299.246490:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738188416 00000100:00100000:2.0:1788940299.246543:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788940299.246549:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003462107d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+11:3307:x1875839738188416:12345-0@lo:400: 00000100:00100000:2.0:1788940299.246586:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003462107d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+11:3307:x1875839738188416:12345-0@lo:400: Request processed in 38us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940299.246592:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788940299.246755:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000677f4454 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3307:1875839738188416:0@lo:400: 10000000:01000000:2.0:1788940299.757583:0:5858:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788940299.757590:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89f188f09000 from 1 10000000:01000000:2.0:1788940299.757594:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788940299.757642:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: 00000000f34a20cc/0x27a633fcdd4a89b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940299.757666:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: 00000000f34a20cc/0x27a633fcdd4a89b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940299.757678:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: 00000000f34a20cc/0x27a633fcdd4a89b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940299.757701:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000886418e0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738188672:0@lo:101: 00000100:00100000:2.0:1788940299.757773:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940299.757834:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set 000000008aedf826 going to sleep for 11 seconds 00000100:00100000:0.0:1788940299.758049:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738188672 00000100:00100000:0.0:1788940299.758058:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738188672 00000100:00100000:0.0:1788940299.758108:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788940299.758117:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000047bc6dd8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+11:5858:x1875839738188672:12345-0@lo:101: 00010000:00010000:0.0:1788940299.758142:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940299.758154:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bcd70417/0x27a633fcdd4a8a2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4a89b expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940299.758176:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bcd70417/0x27a633fcdd4a8a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4a89b expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940299.758185:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bcd70417/0x27a633fcdd4a8a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4a89b expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940299.758194:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bcd70417, rc 0) 00000100:00100000:0.0:1788940299.758244:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000047bc6dd8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+12:5858:x1875839738188672:12345-0@lo:101: Request processed in 128us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940299.758252:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788940299.758282:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000886418e0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738188672:0@lo:101: 00010000:00010000:2.0:1788940299.758298:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: 00000000f34a20cc/0x27a633fcdd4a89b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4a8a2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940299.758307:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: 00000000f34a20cc/0x27a633fcdd4a89b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4a8a2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940299.758360:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000886418e0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738188800:0@lo:501: 00000100:00100000:2.0:1788940299.758387:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940299.758416:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set 000000008aedf826 going to sleep for 11 seconds 00000100:00100000:0.0:1788940299.758729:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738188800 00000100:00100000:0.0:1788940299.758734:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738188800 00000100:00100000:0.0:1788940299.758758:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788940299.758763:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f8eb7b7a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+12:5858:x1875839738188800:12345-0@lo:501: 00000100:00100000:0.0:1788940299.759068:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f8eb7b7a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+12:5858:x1875839738188800:12345-0@lo:501: Request processed in 304us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940299.759076:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788940299.759805:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000886418e0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738188800:0@lo:501: 00000100:00100000:2.0:1788940299.759847:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000886418e0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738188928:0@lo:503: 00000100:00100000:2.0:1788940299.759888:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940299.759911:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set 000000008aedf826 going to sleep for 11 seconds 00000100:00100000:0.0:1788940299.760037:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738188928 00000100:00100000:0.0:1788940299.760042:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738188928 00000100:00100000:0.0:1788940299.760075:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788940299.760081:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ee57565e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+12:5858:x1875839738188928:12345-0@lo:503: 00000100:00100000:0.0:1788940299.760408:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ee57565e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+12:5858:x1875839738188928:12345-0@lo:503: Request processed in 327us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940299.760420:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788940299.760805:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000886418e0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738188928:0@lo:503: 00000100:00100000:3.0:1788940299.761780:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000677f4454 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:6694:1875839738189056:0@lo:502: 00000100:00100000:3.0:1788940299.761834:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940299.761870:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set 00000000417ffcde going to sleep for 11 seconds 00000100:00100000:0.0:1788940299.761922:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738189056 00000100:00100000:0.0:1788940299.761928:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738189056 00000100:00100000:0.0:1788940299.761965:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788940299.761972:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001b058af0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+12:6694:x1875839738189056:12345-0@lo:502: 00000100:00100000:0.0:1788940299.762167:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001b058af0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+12:6694:x1875839738189056:12345-0@lo:502: Request processed in 196us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940299.762175:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788940299.762260:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000677f4454 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:6694:1875839738189056:0@lo:502: 00000020:01000000:3.0:1788940299.762283:0:6694:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788940299.762296:0:6694:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940299.762298:0:6694:0:(obd_config.c:1662:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788940299.762307:0:6694:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: general-ffff89f188f09000 00000020:00000080:3.0:1788940299.762310:0:6694:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788940299.762387:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b48a7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:6694:1875839738189184:0@lo:502: 00000100:00100000:3.0:1788940299.762414:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940299.762434:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f19068a480 going to sleep for 11 seconds 00000100:00100000:2.0:1788940299.762453:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738189184 00000100:00100000:2.0:1788940299.762458:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738189184 00000100:00100000:2.0:1788940299.762493:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788940299.762509:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18415e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+12:6694:x1875839738189184:12345-0@lo:502: 00000100:00100000:2.0:1788940299.762669:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18415e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+12:6694:x1875839738189184:12345-0@lo:502: Request processed in 162us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940299.762678:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788940299.762690:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b48a7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:6694:1875839738189184:0@lo:502: 00000020:01000000:3.0:1788940299.762712:0:6694:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788940299.762716:0:6694:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940299.762717:0:6694:0:(obd_config.c:1662:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788940299.762721:0:6694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1788940299.762784:0:5858:0:(obd_config.c:2244:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788940299.762809:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788940299.762820:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f181521600/0x27a633fcdd4a89b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4a8a2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940299.762834:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f181521600/0x27a633fcdd4a89b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4a8a2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940299.958367:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788940300.161485:0:6703:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788940300.161488:0:6703:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1788940300.161712:0:6703:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff89f19016d800 00000020:01000004:1.0:1788940300.161727:0:6703:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1788940300.161735:0:6703:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788940300.161751:0:6703:0:(genops.c:415:class_newdev()) Allocate new device lustre-OST0000-osd (ffff89f1b51833b0) 00000020:00000080:1.0:1788940300.161769:0:6703:0:(obd_config.c:786:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788940300.171291:0:6703:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1788940300.171460:0:6703:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1788940300.189645:0:6703:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1788940300.193806:0:6703:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788940300.193837:0:6703:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1788940300.193897:0:6703:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788940300.193927:0:6703:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1788940300.194271:0:6703:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1788940300.194282:0:6703:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788940300.194293:0:6703:0:(genops.c:1393:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x27a633fcdd4a8b0 00000020:01000004:1.0:1788940300.194301:0:6703:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1788940300.194320:0:6703:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.114@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788940300.194328:0:6703:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.114@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788940300.194334:0:6703:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1788940300.194339:0:6703:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1788940300.194350:0:6703:0:(genops.c:415:class_newdev()) Allocate new device OSS (ffff89f1b5184d88) 00000020:00000080:1.0:1788940300.194361:0:6703:0:(obd_config.c:786:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:1.0:1788940300.195609:0:6703:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788940300.195777:0:6703:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1788940300.195784:0:6703:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788940300.201098:0:6703:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788940300.201112:0:6703:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1788940300.201484:0:6703:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1788940300.201490:0:6703:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788940300.202830:0:6703:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788940300.203023:0:6703:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788940300.203030:0:6703:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788940300.204997:0:6703:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788940300.205005:0:6703:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788940300.231070:0:6703:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788940300.231327:0:6703:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788940300.231334:0:6703:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788940300.232997:0:6703:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788940300.233009:0:6703:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788940300.233708:0:6703:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788940300.233716:0:6703:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788940300.236225:0:6703:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788940300.236432:0:6703:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788940300.236439:0:6703:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788940300.237224:0:6703:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788940300.237237:0:6703:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788940300.267203:0:6703:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788940300.267401:0:6703:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788940300.267406:0:6703:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788940300.273990:0:6703:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788940300.274006:0:6703:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788940300.274475:0:6703:0:(obd_config.c:900:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788940300.274498:0:6703:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1788940300.274509:0:6703:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.114@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788940300.291920:0:6703:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.114@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788940300.291952:0:6703:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.114@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1788940300.291955:0:6703:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788940300.291956:0:6703:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788940300.291957:0:6703:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788940300.291958:0:6703:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788940300.291959:0:6703:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788940300.291960:0:6703:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788940300.291961:0:6703:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788940300.291962:0:6703:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788940300.291963:0:6703:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788940300.291964:0:6703:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788940300.291965:0:6703:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788940300.291968:0:6703:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1788940300.291969:0:6703:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788940300.291970:0:6703:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788940300.291971:0:6703:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788940300.291971:0:6703:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788940300.291972:0:6703:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788940300.291973:0:6703:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788940300.291973:0:6703:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788940300.291974:0:6703:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788940300.291975:0:6703:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788940300.291975:0:6703:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788940300.291976:0:6703:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788940300.292005:0:6703:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788940300.292021:0:6703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:6703:1875839738189312:0@lo:253: 00000100:00100000:2.0:1788940300.292092:0:6703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940300.292200:0:6703:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f188f2c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788940300.292286:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738189312 00000100:00100000:0.0:1788940300.292294:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738189312 00000100:00100000:0.0:1788940300.292366:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788940300.292375:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18415fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+12:6703:x1875839738189312:12345-0@lo:253: 20000000:01000000:0.0:1788940300.292405:0:5854:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788940300.292409:0:5854:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1788940300.292413:0:5854:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1788940300.292415:0:5854:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1788940300.293169:0:5854:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788940300.293323:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1788940300.293332:0:5854:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1788940300.293356:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1788940300.293360:0:5854:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1788940300.293374:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1788940300.293400:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1788940300.294009:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1788940300.294024:0:5854:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.114@tcp 20000000:01000000:0.0:1788940300.294026:0:5854:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.114@tcp (null) (null) (null) 00000040:00080000:0.0:1788940300.294044:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1788940300.294057:0:5854:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788940300.294086:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1788940300.294091:0:5854:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.114@tcp (null) (null) 00000040:00080000:0.0:1788940300.294107:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1788940300.294112:0:5854:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788940300.294126:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1788940300.294150:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:0.0:1788940300.295187:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1788940300.295202:0:5854:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.114@tcp 20000000:01000000:0.0:1788940300.295204:0:5854:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.114@tcp (null) (null) (null) 00000040:00080000:0.0:1788940300.295240:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1788940300.295245:0:5854:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788940300.295260:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1788940300.295263:0:5854:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.114@tcp (null) (null) 00000040:00080000:0.0:1788940300.295302:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1788940300.295307:0:5854:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788940300.295324:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:0.0:1788940300.295341:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:0.0:1788940300.295349:0:5854:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1788940300.295352:0:5854:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1788940300.295355:0:5854:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788940300.295356:0:5854:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788940300.295358:0:5854:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788940300.295367:0:5854:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788940300.295368:0:5854:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788940300.295389:0:5854:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788940300.295391:0:5854:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788940300.296049:0:6718:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1788940300.296103:0:6718:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1788940300.296140:0:6718:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1788940300.296365:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1788940300.296387:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1788940300.296404:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:0.0:1788940300.296410:0:5854:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788940300.296411:0:5854:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788940300.297004:0:6719:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 10 1->4: lustre sys.timeout 20000000:01000000:3.0:1788940300.297035:0:6719:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 10 2->4: lustre sys.timeout 00000040:00080000:3.0:1788940300.297061:0:6719:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1788940300.297275:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1788940300.297311:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1788940300.297358:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1788940300.297369:0:5854:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788940300.297371:0:5854:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788940300.297972:0:6720:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1788940300.298119:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1788940300.298139:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1788940300.298172:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 10000000:01000000:0.0:1788940300.298183:0:5854:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788940300.298200:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89f180031e00/0x27a633fcdd4a8be lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940300.298229:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89f1c21f1000/0x27a633fcdd4a7d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4a7d0 expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940300.298235:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89f1829dbc00/0x27a633fcdd4a7f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4a7ec expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940300.298239:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89f1829db800/0x27a633fcdd4a863 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4a85c expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940300.298244:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89f180031e00/0x27a633fcdd4a8be lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940300.298281:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89f1829db800/0x27a633fcdd4a863 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27a633fcdd4a85c expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940300.298290:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89f1829db800/0x27a633fcdd4a863 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27a633fcdd4a85c expref: 12 pid: 5855 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940300.298302:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198180380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5854:1875839738189440:0@lo:104: 00000100:00100000:0.0:1788940300.298361:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788940300.298458:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89f1829dbc00/0x27a633fcdd4a7f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27a633fcdd4a7ec expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940300.298466:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89f1829dbc00/0x27a633fcdd4a7f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27a633fcdd4a7ec expref: 12 pid: 5853 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940300.298474:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198180700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5854:1875839738189568:0@lo:104: 00000100:00100000:0.0:1788940300.298495:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788940300.298813:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89f1c21f1000/0x27a633fcdd4a7d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27a633fcdd4a7d0 expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940300.298819:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89f1c21f1000/0x27a633fcdd4a7d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27a633fcdd4a7d0 expref: 12 pid: 5854 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940300.298825:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198181f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5854:1875839738189696:0@lo:104: 00000100:00100000:0.0:1788940300.298840:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940300.298897:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738189440 00000100:00100000:1.0:1788940300.298905:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738189440 00000100:00100000:1.0:1788940300.298936:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738189568 00000100:00100000:1.0:1788940300.298938:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738189568 00000100:00100000:1.0:1788940300.298947:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788940300.298953:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f198181500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+4:5854:x1875839738189440:12345-0@lo:104: 00010000:00010000:1.0:1788940300.298962:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff89f1c21f1800/0x27a633fcdd4a85c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4a863 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940300.299008:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788940300.299012:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f198181500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+4:5854:x1875839738189440:12345-0@lo:104: Request processed in 59us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940300.299017:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788940300.299029:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788940300.299033:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f198183480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+3:5854:x1875839738189568:12345-0@lo:104: 00010000:00010000:1.0:1788940300.299037:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff89f1829dae00/0x27a633fcdd4a7ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4a7f3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940300.299058:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788940300.299068:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f198183480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+3:5854:x1875839738189568:12345-0@lo:104: Request processed in 36us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940300.299072:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1788940300.299119:0:5848:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788940300.299126:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff89f1c21f1800/0x27a633fcdd4a85c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4a863 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940300.299139:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1c21f1800 already unused, calling callback (ffffffffc1d10c20) 10000000:00010000:2.0:1788940300.299142:0:5848:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff89f1c21f1800/0x27a633fcdd4a85c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x27a633fcdd4a863 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940300.299150:0:5848:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff89f1c21f1800/0x27a633fcdd4a85c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x27a633fcdd4a863 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788940300.299157:0:5848:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff89f1c21f1800/0x27a633fcdd4a85c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x27a633fcdd4a863 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940300.299162:0:5848:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788940300.299189:0:5848:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff89f1c21f1800/0x27a633fcdd4a85c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4a863 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940300.299196:0:5848:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788940300.299226:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff89f1c21f1800/0x27a633fcdd4a85c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4a863 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940300.299231:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff89f1c21f1800/0x27a633fcdd4a85c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4a863 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940300.299241:0:5848:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940300.299244:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff89f1829dae00/0x27a633fcdd4a7ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4a7f3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940300.299247:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1829dae00 already unused, calling callback (ffffffffc1d10c20) 10000000:00010000:2.0:1788940300.299249:0:5848:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff89f1829dae00/0x27a633fcdd4a7ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x27a633fcdd4a7f3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940300.299261:0:5848:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff89f1829dae00/0x27a633fcdd4a7ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x27a633fcdd4a7f3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788940300.299265:0:5848:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff89f1829dae00/0x27a633fcdd4a7ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x27a633fcdd4a7f3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940300.299268:0:5848:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788940300.299278:0:5848:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff89f1829dae00/0x27a633fcdd4a7ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4a7f3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940300.299281:0:5848:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788940300.299284:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff89f1829dae00/0x27a633fcdd4a7ec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4a7f3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940300.299288:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff89f1829dae00/0x27a633fcdd4a7ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4a7f3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940300.299295:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940300.299296:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940300.299297:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940300.299313:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3305:1875839738189824:0@lo:103: 00000100:00100000:2.0:1788940300.299335:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940300.299355:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788940300.299358:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3305:1875839738189952:0@lo:103: 00000100:00100000:2.0:1788940300.299368:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940300.299385:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738189824 00000100:00100000:2.0:1788940300.299387:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738189824 00010000:00010000:2.0:1788940300.299400:0:5845:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89f1829db800/0x27a633fcdd4a863 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4a85c expref: 13 pid: 5855 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940300.299421:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738189952 00000100:00100000:2.0:1788940300.299423:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738189952 00010000:00010000:2.0:1788940300.299430:0:5845:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89f1829dbc00/0x27a633fcdd4a7f3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4a7ec expref: 14 pid: 5853 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940300.299437:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788940300.299440:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+14:3305:x1875839738189824:12345-0@lo:103: 00010000:00010000:2.0:1788940300.299447:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940300.299451:0:5845:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89f1829db800/0x27a633fcdd4a863 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4a85c expref: 14 pid: 5855 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940300.299457:0:5845:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89f1829db800/0x27a633fcdd4a863 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27a633fcdd4a85c expref: 14 pid: 5855 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940300.299468:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940300.299486:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+14:3305:x1875839738189824:12345-0@lo:103: Request processed in 46us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940300.299490:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788940300.299498:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788940300.299502:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c6e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+13:3305:x1875839738189952:12345-0@lo:103: 00010000:00010000:2.0:1788940300.299506:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940300.299509:0:5845:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89f1829dbc00/0x27a633fcdd4a7f3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4a7ec expref: 13 pid: 5853 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940300.299514:0:5845:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89f1829dbc00/0x27a633fcdd4a7f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27a633fcdd4a7ec expref: 13 pid: 5853 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940300.299540:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940300.299621:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c6e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+13:3305:x1875839738189952:12345-0@lo:103: Request processed in 118us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940300.299626:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788940300.299657:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3305:1875839738189952:0@lo:103: 00000100:00100000:2.0:1788940300.299677:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3305:1875839738189824:0@lo:103: 00000100:00100000:0.0:1788940300.299806:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1b0c92900 going to sleep for 11 seconds 00010000:00010000:0.0:1788940300.299816:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f1829db800/0x27a633fcdd4a863 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27a633fcdd4a85c expref: 12 pid: 5855 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940300.299824:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198180380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5854:1875839738189440:0@lo:104: 00010000:00010000:0.0:1788940300.299828:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f1829dbc00/0x27a633fcdd4a7f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27a633fcdd4a7ec expref: 11 pid: 5853 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940300.299834:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198180700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5854:1875839738189568:0@lo:104: 00000100:00100000:2.0:1788940300.299900:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738189696 00000100:00100000:2.0:1788940300.299903:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738189696 00000100:00100000:2.0:1788940300.299918:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788940300.299922:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f198181880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+3:5854:x1875839738189696:12345-0@lo:104: 00010000:00010000:2.0:1788940300.299928:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff89f180031a00/0x27a633fcdd4a7d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4a7d7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940300.299974:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788940300.299978:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f198181880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+3:5854:x1875839738189696:12345-0@lo:104: Request processed in 56us (1137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940300.299982:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1788940300.300017:0:5848:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940300.300020:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff89f180031a00/0x27a633fcdd4a7d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4a7d7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940300.300025:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f180031a00 already unused, calling callback (ffffffffc1d10c20) 10000000:00010000:1.0:1788940300.300027:0:5848:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff89f180031a00/0x27a633fcdd4a7d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x27a633fcdd4a7d7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940300.300031:0:5848:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff89f180031a00/0x27a633fcdd4a7d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x27a633fcdd4a7d7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788940300.300034:0:5848:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff89f180031a00/0x27a633fcdd4a7d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x27a633fcdd4a7d7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940300.300038:0:5848:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788940300.300056:0:5848:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff89f180031a00/0x27a633fcdd4a7d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4a7d7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940300.300059:0:5848:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788940300.300070:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff89f180031a00/0x27a633fcdd4a7d0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4a7d7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940300.300074:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff89f180031a00/0x27a633fcdd4a7d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4a7d7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940300.300084:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940300.300085:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940300.300086:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940300.300133:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788940300.300140:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4f64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3308:1875839738190080:0@lo:103: 00000100:00100000:0.0:1788940300.300159:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940300.300218:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198181f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5854:1875839738189696:0@lo:104: 00010000:00010000:0.0:1788940300.300235:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89f180031e00/0x27a633fcdd4a8be lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940300.300284:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940300.300304:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738190080 00000100:00100000:2.0:1788940300.300307:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738190080 00010000:00010000:2.0:1788940300.300317:0:5845:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89f1c21f1000/0x27a633fcdd4a7d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4a7d0 expref: 11 pid: 5854 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940300.300335:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788940300.300340:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f198180000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+11:3308:x1875839738190080:12345-0@lo:103: 00010000:00010000:2.0:1788940300.300345:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940300.300347:0:5845:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89f1c21f1000/0x27a633fcdd4a7d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4a7d0 expref: 11 pid: 5854 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940300.300353:0:5845:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89f1c21f1000/0x27a633fcdd4a7d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27a633fcdd4a7d0 expref: 11 pid: 5854 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940300.300364:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f1c21f1000/0x27a633fcdd4a7d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27a633fcdd4a7d0 expref: 11 pid: 5854 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940300.300373:0:5845:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89f180031e00/0x27a633fcdd4a8be lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940300.300379:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f180031e00/0x27a633fcdd4a8be lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940300.300388:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89f180031e00/0x27a633fcdd4a8be lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940300.300393:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89f180031e00/0x27a633fcdd4a8be lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940300.300397:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89f180031e00/0x27a633fcdd4a8be lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940300.300401:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89f180031e00/0x27a633fcdd4a8be lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940300.300404:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f180031e00 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:2.0:1788940300.300406:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89f180031e00/0x27a633fcdd4a8be lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940300.300410:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89f180031e00/0x27a633fcdd4a8be lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940300.300423:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89f180031e00/0x27a633fcdd4a8be lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940300.300436:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940300.300454:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f198180000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+10:3308:x1875839738190080:12345-0@lo:103: Request processed in 114us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940300.300458:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788940300.300499:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4f64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3308:1875839738190080:0@lo:103: 00010000:00010000:1.0:1788940300.300544:0:5854:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89f180031e00/0x27a633fcdd4a8be lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940300.300549:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89f180031e00/0x27a633fcdd4a8be lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940300.300553:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f180031e00/0x27a633fcdd4a8be lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788940300.300674:0:5854:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788940300.360481:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18415fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+9:6703:x1875839738189312:12345-0@lo:253: Request processed in 68097us (68377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940300.360499:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788940300.360634:0:6703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:6703:1875839738189312:0@lo:253: 10000000:01000000:0.0:1788940300.360669:0:6703:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788940300.360672:0:6703:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788940300.360674:0:6703:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788940300.360676:0:6703:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788940300.360677:0:6703:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1788940300.360678:0:6703:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788940300.360679:0:6703:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788940300.360681:0:6703:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788940300.360682:0:6703:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788940300.360684:0:6703:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788940300.360685:0:6703:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788940300.360707:0:6703:0:(tgt_mount.c:101:server_register_mount()) register mount ffff89f19016d800 from lustre-OST0000 10000000:01000000:0.0:1788940300.360734:0:6703:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788940300.360737:0:6703:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788940300.360754:0:6703:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff89f1982e0000 local copy 10000000:01000000:0.0:1788940300.360758:0:6703:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788940300.360797:0:6703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f180031800/0x27a633fcdd4a8c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940300.360809:0:6703:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.114@tcp lock: ffff89f180031800/0x27a633fcdd4a8c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940300.360818:0:6703:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f180031800/0x27a633fcdd4a8c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940300.360837:0:6703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198181f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:6703:1875839738190208:0@lo:101: 00000100:00100000:0.0:1788940300.361127:0:6703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940300.361247:0:6703:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1b0c923c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788940300.364051:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738190208 00000100:00100000:1.0:1788940300.364069:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738190208 00000100:00100000:1.0:1788940300.364156:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788940300.364168:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18415d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+9:6703:x1875839738190208:12345-0@lo:101: 00010000:00010000:1.0:1788940300.364186:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940300.364812:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f1c21f1000/0x27a633fcdd4a8cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4a8c5 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940300.364845:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f1c21f1000/0x27a633fcdd4a8cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4a8c5 expref: 10 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940300.364872:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f1c21f1000/0x27a633fcdd4a8cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4a8c5 expref: 10 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940300.364882:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f1c21f1000, rc 0) 00000100:00100000:1.0:1788940300.364965:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18415d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+10:6703:x1875839738190208:12345-0@lo:101: Request processed in 799us (3837us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940300.364972:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788940300.364991:0:6703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198181f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:6703:1875839738190208:0@lo:101: 00010000:00010000:2.0:1788940300.365008:0:6703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f180031800/0x27a633fcdd4a8c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x27a633fcdd4a8cc expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940300.365018:0:6703:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f180031800/0x27a633fcdd4a8c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x27a633fcdd4a8cc expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940300.365136:0:6703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:6703:1875839738190336:0@lo:501: 00000100:00100000:2.0:1788940300.365174:0:6703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940300.365228:0:6703:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f190209a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788940300.365312:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738190336 00000100:00100000:1.0:1788940300.365316:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738190336 00000100:00100000:1.0:1788940300.365343:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788940300.365350:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+10:6703:x1875839738190336:12345-0@lo:501: 00000100:00100000:1.0:1788940300.365514:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+10:6703:x1875839738190336:12345-0@lo:501: Request processed in 164us (340us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788940300.365551:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788940300.365560:0:6703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:6703:1875839738190336:0@lo:501: 10000000:01000000:2.0:1788940300.365572:0:6703:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.114@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788940300.365597:0:6703:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.114@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788940300.365602:0:6703:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f180031800/0x27a633fcdd4a8c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x27a633fcdd4a8cc expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940300.365610:0:6703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f180031800/0x27a633fcdd4a8c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x27a633fcdd4a8cc expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940300.365776:0:6703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.114@tcp lock: ffff89f180031800/0x27a633fcdd4a8c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x27a633fcdd4a8cc expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940300.365803:0:6703:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788940300.365829:0:5848:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:2.0:1788940300.365830:0:6703:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff89f19016d800 10000000:01000000:2.0:1788940300.365835:0:6703:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788940300.365835:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff89f180031800/0x27a633fcdd4a8c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x27a633fcdd4a8cc expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940300.365839:0:6703:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff89f1982e0000 10000000:01000000:2.0:1788940300.365842:0:6703:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1788940300.365842:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f180031800 already unused, calling callback (ffffffffc1d10c20) 10000000:01000000:2.0:1788940300.365845:0:6703:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff89f1982e0000 from 1 10000000:00010000:1.0:1788940300.365846:0:5848:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff89f180031800/0x27a633fcdd4a8c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x27a633fcdd4a8cc expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940300.365848:0:6703:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788940300.365865:0:5848:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff89f180031800/0x27a633fcdd4a8c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x27a633fcdd4a8cc expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940300.365869:0:6703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f181520200/0x27a633fcdd4a8d3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788940300.365873:0:5848:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff89f180031800/0x27a633fcdd4a8c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x27a633fcdd4a8cc expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940300.365877:0:6703:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f181520200/0x27a633fcdd4a8d3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940300.365879:0:5848:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788940300.365885:0:6703:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f181520200/0x27a633fcdd4a8d3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940300.365895:0:5848:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff89f180031800/0x27a633fcdd4a8c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x27a633fcdd4a8cc expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940300.365897:0:6703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:6703:1875839738190464:0@lo:101: 00010000:00010000:1.0:1788940300.365901:0:5848:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788940300.365923:0:6703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788940300.365929:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff89f180031800/0x27a633fcdd4a8c5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x27a633fcdd4a8cc expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940300.365936:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff89f180031800/0x27a633fcdd4a8c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x27a633fcdd4a8cc expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940300.365944:0:6703:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f190209000 going to sleep for 11 seconds 00010000:00010000:1.0:1788940300.365960:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940300.365962:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940300.365963:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940300.365971:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738190464 00000100:00100000:1.0:1788940300.365975:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738190464 00000100:00100000:3.0:1788940300.365989:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788940300.365999:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4f66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3307:1875839738190592:0@lo:103: 00000100:00100000:1.0:1788940300.365999:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788940300.366006:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+10:6703:x1875839738190464:12345-0@lo:101: 00010000:00010000:1.0:1788940300.366013:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940300.366022:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f1c21f1800/0x27a633fcdd4a8da lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4a8d3 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940300.366027:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788940300.366038:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f1c21f1800/0x27a633fcdd4a8da lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4a8d3 expref: 11 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940300.366047:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f1c21f1800/0x27a633fcdd4a8da lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4a8d3 expref: 11 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940300.366054:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738190592 00010000:00010000:1.0:1788940300.366054:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f1c21f1800, rc 0) 00000100:00100000:3.0:1788940300.366057:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738190592 00000100:00100000:1.0:1788940300.366079:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+12:6703:x1875839738190464:12345-0@lo:101: Request processed in 74us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940300.366085:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788940300.366085:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788940300.366091:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b48a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+12:3307:x1875839738190592:12345-0@lo:103: 00010000:00010000:3.0:1788940300.366100:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940300.366111:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f1c21f1000/0x27a633fcdd4a8cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x27a633fcdd4a8c5 expref: 11 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940300.366123:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940300.366231:0:6703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:6703:1875839738190464:0@lo:101: 00010000:00010000:2.0:1788940300.366242:0:6703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f181520200/0x27a633fcdd4a8d3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4a8da expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940300.366250:0:6703:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f181520200/0x27a633fcdd4a8d3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4a8da expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940300.366265:0:6703:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788940300.366282:0:6703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f181520200/0x27a633fcdd4a8d3 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4a8da expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940300.366290:0:6703:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f181520200/0x27a633fcdd4a8d3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4a8da expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940300.366303:0:6703:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788940300.366306:0:6703:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788940300.366311:0:6703:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788940300.366313:0:6703:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788940300.366326:0:6703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f181520c00/0x27a633fcdd4a8e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940300.366333:0:6703:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f181520c00/0x27a633fcdd4a8e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940300.366341:0:6703:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f181520c00/0x27a633fcdd4a8e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940300.366352:0:6703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:6703:1875839738190720:0@lo:101: 00000100:00100000:2.0:1788940300.366376:0:6703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940300.366400:0:6703:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f190209000 going to sleep for 11 seconds 00000100:00100000:3.0:1788940300.366441:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b48a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+10:3307:x1875839738190592:12345-0@lo:103: Request processed in 349us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940300.366449:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788940300.366500:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4f66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3307:1875839738190592:0@lo:103: 00000100:00100000:0.0:1788940300.366730:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738190720 00000100:00100000:0.0:1788940300.366735:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738190720 00000100:00100000:0.0:1788940300.366772:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788940300.366779:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+10:6703:x1875839738190720:12345-0@lo:101: 00010000:00010000:0.0:1788940300.366787:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940300.366796:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f180030a00/0x27a633fcdd4a8e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4a8e1 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940300.366811:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f180030a00/0x27a633fcdd4a8e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4a8e1 expref: 11 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940300.366816:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f180030a00/0x27a633fcdd4a8e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4a8e1 expref: 11 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940300.366820:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f180030a00, rc 0) 00000100:00100000:0.0:1788940300.366850:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+11:6703:x1875839738190720:12345-0@lo:101: Request processed in 72us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940300.366866:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788940300.366879:0:6703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:6703:1875839738190720:0@lo:101: 00010000:00010000:2.0:1788940300.366890:0:6703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f181520c00/0x27a633fcdd4a8e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4a8e8 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940300.366897:0:6703:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f181520c00/0x27a633fcdd4a8e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4a8e8 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940300.366969:0:6703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:6703:1875839738190848:0@lo:501: 00000100:00100000:2.0:1788940300.366994:0:6703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940300.367056:0:6703:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f190209000 going to sleep for 11 seconds 00000100:00100000:3.0:1788940300.367094:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738190848 00000100:00100000:3.0:1788940300.367098:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738190848 00000100:00100000:3.0:1788940300.367128:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788940300.367135:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+11:6703:x1875839738190848:12345-0@lo:501: 00000100:00100000:3.0:1788940300.367407:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+11:6703:x1875839738190848:12345-0@lo:501: Request processed in 272us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940300.367414:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788940300.367489:0:6703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:6703:1875839738190848:0@lo:501: 00000100:00100000:2.0:1788940300.367836:0:6703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:6703:1875839738190976:0@lo:503: 00000100:00100000:2.0:1788940300.367877:0:6703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940300.367906:0:6703:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f190209000 going to sleep for 11 seconds 00000100:00100000:0.0:1788940300.367925:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738190976 00000100:00100000:0.0:1788940300.367930:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738190976 00000100:00100000:0.0:1788940300.367965:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788940300.367973:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+11:6703:x1875839738190976:12345-0@lo:503: 00000100:00100000:0.0:1788940300.368122:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+11:6703:x1875839738190976:12345-0@lo:503: Request processed in 149us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940300.368129:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788940300.368152:0:6703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:6703:1875839738190976:0@lo:503: 00000040:00080000:0.0:1788940300.381468:0:6703:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788940300.382499:0:6703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198180700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:6703:1875839738191104:0@lo:502: 00000100:00100000:1.0:1788940300.383033:0:6703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940300.383157:0:6703:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1b0c92600 going to sleep for 11 seconds 00000100:00100000:2.0:1788940300.383239:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738191104 00000100:00100000:2.0:1788940300.383250:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738191104 00000100:00100000:2.0:1788940300.383351:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788940300.383362:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+11:6703:x1875839738191104:12345-0@lo:502: 00000100:00100000:2.0:1788940300.383611:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+11:6703:x1875839738191104:12345-0@lo:502: Request processed in 250us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940300.383618:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788940300.384040:0:6703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198180700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:6703:1875839738191104:0@lo:502: 00000040:00080000:1.0:1788940300.384375:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788940300.384434:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1788940300.384482:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1788940300.384555:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1788940300.384593:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1788940300.384625:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1788940300.384779:0:6703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4f66680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:6703:1875839738191232:0@lo:502: 00000100:00100000:1.0:1788940300.384832:0:6703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940300.385403:0:6703:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1a14900c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788940300.385475:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738191232 00000100:00100000:0.0:1788940300.385490:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738191232 00000100:00100000:0.0:1788940300.385558:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788940300.385570:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+11:6703:x1875839738191232:12345-0@lo:502: 00000100:00100000:0.0:1788940300.385977:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+11:6703:x1875839738191232:12345-0@lo:502: Request processed in 408us (1143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940300.385985:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788940300.386101:0:6703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4f66680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:6703:1875839738191232:0@lo:502: 00000040:00080000:1.0:1788940300.386204:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1788940300.386229:0:6703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:1.0:1788940300.386900:0:6723:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788940300.386907:0:6723:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1788940300.386912:0:6723:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940300.386914:0:6723:0:(obd_config.c:1662:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788940300.386918:0:6723:0:(obd_config.c:1571:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788940300.386929:0:6723:0:(genops.c:415:class_newdev()) Allocate new device lustre-OST0000 (ffff89f1b51819d8) 00000020:00000080:1.0:1788940300.386945:0:6723:0:(obd_config.c:786:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788940300.386948:0:6723:0:(obd_config.c:1571:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788940300.386998:0:6723:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89f19016d800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788940300.387002:0:6723:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788940300.387007:0:6723:0:(genops.c:1393:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x27a633fcdd4a8f6 00010000:00010000:1.0:1788940300.393381:0:6723:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:1.0:1788940300.393863:0:6723:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1788940300.396110:0:6723:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1788940300.396384:0:6723:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1788940300.402288:0:6723:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1788940300.403365:0:6723:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1788940300.406147:0:6723:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788940300.406162:0:6723:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788940300.406170:0:6723:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940300.406172:0:6723:0:(obd_config.c:1662:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788940300.406177:0:6723:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788940300.406182:0:6723:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940300.406183:0:6723:0:(obd_config.c:1662:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788940300.406186:0:6723:0:(obd_config.c:1571:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788940300.406189:0:6723:0:(obd_config.c:1636:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788940300.406266:0:6723:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788940300.406271:0:6723:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940300.406272:0:6723:0:(obd_config.c:1662:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788940300.406276:0:6723:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788940300.406484:0:6703:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1788940300.406508:0:6703:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788940300.406685:0:6703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f181520c00/0x27a633fcdd4a8e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4a8e8 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940300.406712:0:6703:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f181520c00/0x27a633fcdd4a8e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4a8e8 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940300.406720:0:6703:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89f19016d800 from 1 10000000:01000000:1.0:1788940300.406723:0:6703:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788940300.406762:0:6703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f1c21f1200/0x27a633fcdd4a8fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940300.406770:0:6703:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f1c21f1200/0x27a633fcdd4a8fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940300.406783:0:6703:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f1c21f1200/0x27a633fcdd4a8fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940300.406809:0:6703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4f66680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:6703:1875839738191360:0@lo:101: 00000100:00100000:1.0:1788940300.406878:0:6703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940300.406930:0:6703:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1b5b323c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788940300.419774:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738191360 00000100:00100000:3.0:1788940300.419791:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738191360 00000100:00100000:3.0:1788940300.419848:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788940300.419860:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+11:6703:x1875839738191360:12345-0@lo:101: 00010000:00010000:3.0:1788940300.419879:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940300.419898:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f1829db200/0x27a633fcdd4a904 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4a8fd expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940300.419929:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f1829db200/0x27a633fcdd4a904 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4a8fd expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940300.419940:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f1829db200/0x27a633fcdd4a904 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4a8fd expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940300.419948:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f1829db200, rc 0) 00000100:00100000:3.0:1788940300.420034:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+12:6703:x1875839738191360:12345-0@lo:101: Request processed in 176us (13155us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940300.420041:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788940300.420062:0:6703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4f66680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:6703:1875839738191360:0@lo:101: 00010000:00010000:0.0:1788940300.420081:0:6703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f1c21f1200/0x27a633fcdd4a8fd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4a904 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940300.420091:0:6703:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f1c21f1200/0x27a633fcdd4a8fd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4a904 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940300.420204:0:6703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198180380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:6703:1875839738191488:0@lo:501: 00000100:00100000:0.0:1788940300.420258:0:6703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940300.420285:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738191488 00000100:00100000:3.0:1788940300.420294:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738191488 00000100:00100000:0.0:1788940300.420297:0:6703:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f187c030c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788940300.420315:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788940300.420322:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+12:6703:x1875839738191488:12345-0@lo:501: 00000100:00100000:3.0:1788940300.420498:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+12:6703:x1875839738191488:12345-0@lo:501: Request processed in 176us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940300.420505:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788940300.420547:0:6703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198180380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:6703:1875839738191488:0@lo:501: 00000100:00100000:0.0:1788940300.420574:0:6703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198180380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:6703:1875839738191616:0@lo:503: 00000100:00100000:0.0:1788940300.420610:0:6703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940300.420704:0:6703:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f187c030c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788940300.421002:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738191616 00000100:00100000:3.0:1788940300.421005:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738191616 00000100:00100000:3.0:1788940300.421029:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788940300.421036:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+12:6703:x1875839738191616:12345-0@lo:503: 00000100:00100000:3.0:1788940300.421189:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+12:6703:x1875839738191616:12345-0@lo:503: Request processed in 152us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940300.421196:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788940300.421224:0:6703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198180380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:6703:1875839738191616:0@lo:503: 00000040:00080000:0.0:1788940300.421502:0:6703:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788940300.421576:0:6703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198180380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:6703:1875839738191744:0@lo:502: 00000100:00100000:0.0:1788940300.421612:0:6703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940300.421718:0:6703:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f187c030c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788940300.421726:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738191744 00000100:00100000:1.0:1788940300.421731:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738191744 00000100:00100000:1.0:1788940300.421772:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788940300.421779:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+12:6703:x1875839738191744:12345-0@lo:502: 00000100:00100000:1.0:1788940300.421899:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+12:6703:x1875839738191744:12345-0@lo:502: Request processed in 121us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940300.421906:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788940300.421920:0:6703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198180380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:6703:1875839738191744:0@lo:502: 00000040:00080000:0.0:1788940300.422148:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1788940300.422191:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1788940300.422232:0:6703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198180380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:6703:1875839738191872:0@lo:502: 00000100:00100000:0.0:1788940300.422265:0:6703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940300.422290:0:6703:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f187c030c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940300.422558:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738191872 00000100:00100000:2.0:1788940300.422564:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738191872 00000100:00100000:2.0:1788940300.422591:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788940300.422598:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+12:6703:x1875839738191872:12345-0@lo:502: 00000100:00100000:2.0:1788940300.422923:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+12:6703:x1875839738191872:12345-0@lo:502: Request processed in 325us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940300.422929:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788940300.423035:0:6703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198180380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:6703:1875839738191872:0@lo:502: 00000040:00080000:0.0:1788940300.423115:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1788940300.423124:0:6703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1788940300.423887:0:6727:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788940300.423896:0:6727:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940300.423899:0:6727:0:(obd_config.c:1662:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788940300.423907:0:6727:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: general-ffff89f19016d800 00000020:00000080:2.0:1788940300.423909:0:6727:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788940300.423928:0:6727:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788940300.423931:0:6727:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940300.423933:0:6727:0:(obd_config.c:1662:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788940300.423935:0:6727:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1788940300.424075:0:6703:0:(obd_config.c:2244:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788940300.424092:0:6703:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788940300.424354:0:6703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f1c21f1200/0x27a633fcdd4a8fd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4a904 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940300.424367:0:6703:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f1c21f1200/0x27a633fcdd4a8fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4a904 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940300.424404:0:6703:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788940300.424407:0:6703:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff89f19016d800 10000000:01000000:0.0:1788940300.424410:0:6703:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff89f19016d800 10000000:01000000:0.0:1788940300.424414:0:6703:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788940300.424420:0:6703:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff89f19016d800 from 1 10000000:01000000:0.0:1788940300.424422:0:6703:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788940300.424457:0:6703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f180031800/0x27a633fcdd4a90b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940300.424466:0:6703:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f180031800/0x27a633fcdd4a90b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940300.424476:0:6703:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f180031800/0x27a633fcdd4a90b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940300.424498:0:6703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198180380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:6703:1875839738192000:0@lo:101: 00000100:00100000:0.0:1788940300.424583:0:6703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940300.424619:0:6703:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f187c03b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788940300.425034:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738192000 00000100:00100000:2.0:1788940300.425042:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738192000 00000100:00100000:2.0:1788940300.425079:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788940300.425087:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+12:6703:x1875839738192000:12345-0@lo:101: 00010000:00010000:2.0:1788940300.425098:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940300.425111:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f181521a00/0x27a633fcdd4a912 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4a90b expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940300.425133:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f181521a00/0x27a633fcdd4a912 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4a90b expref: 13 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940300.425142:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f181521a00/0x27a633fcdd4a912 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4a90b expref: 13 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940300.425150:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f181521a00, rc 0) 00000100:00100000:2.0:1788940300.425186:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+13:6703:x1875839738192000:12345-0@lo:101: Request processed in 99us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940300.425192:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788940300.425358:0:6703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198180380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:6703:1875839738192000:0@lo:101: 00010000:00010000:0.0:1788940300.425371:0:6703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f180031800/0x27a633fcdd4a90b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4a912 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940300.425379:0:6703:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f180031800/0x27a633fcdd4a90b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4a912 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940300.425459:0:6703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198180380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:6703:1875839738192128:0@lo:501: 00000100:00100000:0.0:1788940300.425483:0:6703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940300.425510:0:6703:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f187c03b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788940300.425580:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738192128 00000100:00100000:2.0:1788940300.425584:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738192128 00000100:00100000:2.0:1788940300.425613:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788940300.425620:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+13:6703:x1875839738192128:12345-0@lo:501: 00000100:00100000:2.0:1788940300.425882:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+13:6703:x1875839738192128:12345-0@lo:501: Request processed in 262us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940300.425888:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788940300.426071:0:6703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198180380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:6703:1875839738192128:0@lo:501: 00000100:00100000:0.0:1788940300.426091:0:6703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198180380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:6703:1875839738192256:0@lo:503: 00000100:00100000:0.0:1788940300.426117:0:6703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940300.426139:0:6703:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f187c03b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788940300.426151:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738192256 00000100:00100000:3.0:1788940300.426156:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738192256 00000100:00100000:3.0:1788940300.426187:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788940300.426194:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+13:6703:x1875839738192256:12345-0@lo:503: 00000100:00100000:3.0:1788940300.426337:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+13:6703:x1875839738192256:12345-0@lo:503: Request processed in 144us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940300.426344:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788940300.426359:0:6703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198180380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:6703:1875839738192256:0@lo:503: 00000040:00080000:0.0:1788940300.426590:0:6703:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788940300.426638:0:6703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198180380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:6703:1875839738192384:0@lo:502: 00000100:00100000:0.0:1788940300.426930:0:6703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940300.426974:0:6703:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f187c03b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788940300.427003:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738192384 00000100:00100000:2.0:1788940300.427006:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738192384 00000100:00100000:2.0:1788940300.427028:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788940300.427035:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+13:6703:x1875839738192384:12345-0@lo:502: 00000100:00100000:2.0:1788940300.427191:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+13:6703:x1875839738192384:12345-0@lo:502: Request processed in 157us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940300.427196:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788940300.427251:0:6703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198180380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:6703:1875839738192384:0@lo:502: 00000040:00080000:0.0:1788940300.427423:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788940300.427459:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788940300.427476:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788940300.427499:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788940300.427560:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788940300.427622:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788940300.427651:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788940300.427827:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788940300.427861:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788940300.427891:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788940300.427908:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788940300.427934:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788940300.427951:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788940300.427967:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788940300.427999:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788940300.428019:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788940300.428035:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788940300.428058:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788940300.428075:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788940300.428090:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788940300.428112:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788940300.428129:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788940300.428145:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788940300.428167:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788940300.428184:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1788940300.428229:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1788940300.428278:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1788940300.428314:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:0.0:1788940300.428341:0:6703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198180380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:6703:1875839738192512:0@lo:502: 00000100:00100000:0.0:1788940300.428379:0:6703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940300.428436:0:6703:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f187c03b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788940300.428473:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738192512 00000100:00100000:3.0:1788940300.428478:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738192512 00000100:00100000:3.0:1788940300.428511:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788940300.428571:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18416d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+13:6703:x1875839738192512:12345-0@lo:502: 00000100:00100000:3.0:1788940300.428817:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18416d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+13:6703:x1875839738192512:12345-0@lo:502: Request processed in 298us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940300.428823:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788940300.428877:0:6703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198180380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:6703:1875839738192512:0@lo:502: 00000040:00080000:0.0:1788940300.428931:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1788940300.428946:0:6703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1788940300.429349:0:6728:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788940300.429366:0:6728:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff89f1bf868000) 00000020:00000080:3.0:1788940300.429383:0:6728:0:(obd_config.c:786:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1788940300.429438:0:6728:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89f19016d800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788940300.429441:0:6728:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89f19016d800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788940300.429444:0:6728:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89f19016d800 3 00010000:00080000:3.0:1788940300.429464:0:6728:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89f1c1871000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.114@tcp at head 00010000:00010000:2.0:1788940300.431078:0:6728:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:2.0:1788940300.431287:0:6728:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788940300.431319:0:6728:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788940300.431330:0:6728:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x27a633fcdd4a920 00000100:00080000:2.0:1788940300.431340:0:6728:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788940300.431346:0:6728:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89f1c1871000 using connection 192.168.202.114@tcp/0@lo 00000100:00100000:2.0:1788940300.431383:0:6728:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89f1b5c6fb80 x1875839738192640/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788940300.431416:0:6728:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788940300.431761:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1875839738192640:0@lo:38: 00000100:00100000:0.0:1788940300.431822:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940300.431884:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738192640 00000100:00100000:0.0:1788940300.431891:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738192640 00000100:00100000:0.0:1788940300.431923:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788940300.431931:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f198180380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1875839738192640:12345-0@lo:38: 00010000:00080000:0.0:1788940300.431954:0:5860:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 243 last 0 00000020:00000080:0.0:1788940300.431978:0:5860:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x27a633fcdd4a927 00000004:00100000:0.0:1788940300.431992:0:5860:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788940300.432020:0:5860:0:(import.c:65:import_set_state_nolock()) ffff89f1aeedd800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788940300.432065:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f198180380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875839738192640:12345-0@lo:38: Request processed in 133us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940300.432072:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788940300.432107:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff89f1b5c6fb80 x1875839738192640/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788940310 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940300.432117:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788940300.432124:0:3304:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1788940300.432132:0:3304:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788940300.432136:0:3304:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788940300.432138:0:3304:0:(import.c:65:import_set_state_nolock()) ffff89f1c1871000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788940300.432143:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1875839738192640:0@lo:38: 00000100:00100000:1.0:1788940300.432434:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788940300.432444:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4f64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875839738192768:0@lo:400: 00000100:00100000:1.0:1788940300.432475:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940300.432513:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738192768 00000100:00100000:1.0:1788940300.432536:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738192768 00000100:00100000:1.0:1788940300.432567:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788940300.432574:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875839738192768:12345-0@lo:400: 00000100:00100000:1.0:1788940300.432613:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875839738192768:12345-0@lo:400: Request processed in 39us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940300.432620:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788940300.432806:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff89f1b4f64380 x1875839738192768/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940300.432816:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4f64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875839738192768:0@lo:400: 00000040:00080000:2.0:1788940300.433763:0:6728:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:1.0:1788940300.433919:0:6703:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1788940300.433944:0:6703:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788940300.433963:0:6703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f180031800/0x27a633fcdd4a90b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4a912 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940300.433971:0:6703:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f180031800/0x27a633fcdd4a90b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4a912 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788940300.434007:0:6703:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788940300.434008:0:6703:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788940300.434009:0:6703:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788940300.434010:0:6703:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788940300.434010:0:6703:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788940300.434012:0:6703:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788940300.434013:0:6703:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788940300.434014:0:6703:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788940300.434015:0:6703:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788940300.434016:0:6703:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788940300.434017:0:6703:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788940300.434020:0:6703:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1788940300.434022:0:6703:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788940300.434023:0:6703:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788940300.434026:0:6703:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788940300.434026:0:6703:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788940300.434027:0:6703:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788940300.434027:0:6703:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788940300.434028:0:6703:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788940300.434029:0:6703:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788940300.434029:0:6703:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788940300.434030:0:6703:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788940300.434030:0:6703:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788940300.434045:0:6703:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788940300.434054:0:6703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4f64380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:6703:1875839738192896:0@lo:253: 00000100:00100000:1.0:1788940300.434089:0:6703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940300.434117:0:6703:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1b5b32240 going to sleep for 11 seconds 00000100:00100000:3.0:1788940300.434126:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738192896 00000100:00100000:3.0:1788940300.434131:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738192896 00000100:00100000:3.0:1788940300.434167:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788940300.434176:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18416f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+13:6703:x1875839738192896:12345-0@lo:253: 20000000:01000000:3.0:1788940300.434196:0:5854:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788940300.434218:0:5854:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788940300.451070:0:5854:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788940300.451084:0:5854:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788940300.451104:0:5876:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788940300.451110:0:5876:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788940300.451131:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89f180031e00/0x27a633fcdd4a92e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940300.451158:0:5876:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89f1829da800/0x27a633fcdd4a886 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4a87f expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940300.451167:0:5876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89f180031e00/0x27a633fcdd4a92e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940300.451220:0:5876:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89f1829da800/0x27a633fcdd4a886 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27a633fcdd4a87f expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940300.451234:0:5876:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89f1829da800/0x27a633fcdd4a886 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27a633fcdd4a87f expref: 13 pid: 5853 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940300.451248:0:5876:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198181c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5876:1875839738193024:0@lo:104: 00000100:00100000:0.0:1788940300.451313:0:5876:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940300.451407:0:5876:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f187c03b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788940300.451456:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738193024 00000100:00100000:3.0:1788940300.451465:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738193024 00000100:00100000:3.0:1788940300.451578:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788940300.451588:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f198180700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+3:5876:x1875839738193024:12345-0@lo:104: 00010000:00010000:3.0:1788940300.451601:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff89f180030c00/0x27a633fcdd4a87f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4a886 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940300.451660:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788940300.451665:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f198180700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+3:5876:x1875839738193024:12345-0@lo:104: Request processed in 79us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940300.451673:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788940300.451730:0:5876:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198181c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5876:1875839738193024:0@lo:104: 00010000:00010000:0.0:1788940300.451747:0:5876:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89f180031e00/0x27a633fcdd4a92e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940300.451786:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940300.451791:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff89f180030c00/0x27a633fcdd4a87f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4a886 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940300.451807:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f180030c00 already unused, calling callback (ffffffffc1d10c20) 10000000:00010000:3.0:1788940300.451811:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff89f180030c00/0x27a633fcdd4a87f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x27a633fcdd4a886 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940300.451819:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff89f180030c00/0x27a633fcdd4a87f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x27a633fcdd4a886 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788940300.451825:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff89f180030c00/0x27a633fcdd4a87f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x27a633fcdd4a886 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940300.451830:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788940300.451858:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff89f180030c00/0x27a633fcdd4a87f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4a886 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940300.451863:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788940300.451879:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff89f180030c00/0x27a633fcdd4a87f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4a886 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940300.451887:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff89f180030c00/0x27a633fcdd4a87f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4a886 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940300.451904:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940300.451904:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b48a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3306:1875839738193152:0@lo:103: 00010000:00010000:3.0:1788940300.451907:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940300.451910:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940300.451946:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940300.452063:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738193152 00000100:00100000:3.0:1788940300.452068:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738193152 00010000:00010000:3.0:1788940300.452083:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89f1829da800/0x27a633fcdd4a886 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4a87f expref: 14 pid: 5853 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940300.452139:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788940300.452153:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1841b6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+14:3306:x1875839738193152:12345-0@lo:103: 00010000:00010000:3.0:1788940300.452164:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940300.452169:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89f1829da800/0x27a633fcdd4a886 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4a87f expref: 14 pid: 5853 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940300.452178:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89f1829da800/0x27a633fcdd4a886 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27a633fcdd4a87f expref: 14 pid: 5853 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940300.452190:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f1829da800/0x27a633fcdd4a886 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27a633fcdd4a87f expref: 14 pid: 5853 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940300.452202:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89f180031e00/0x27a633fcdd4a92e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940300.452222:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f180031e00/0x27a633fcdd4a92e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788940300.452233:0:5846:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003308607s 00010000:00010000:3.0:1788940300.452237:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89f180031e00/0x27a633fcdd4a92e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940300.452244:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89f180031e00/0x27a633fcdd4a92e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940300.452250:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89f180031e00/0x27a633fcdd4a92e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940300.452256:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89f180031e00/0x27a633fcdd4a92e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940300.452260:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f180031e00 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:3.0:1788940300.452264:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89f180031e00/0x27a633fcdd4a92e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940300.452275:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89f180031e00/0x27a633fcdd4a92e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940300.452402:0:5876:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89f180031e00/0x27a633fcdd4a92e lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940300.452410:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89f180031e00/0x27a633fcdd4a92e lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940300.452439:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89f180031e00/0x27a633fcdd4a92e lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940300.452445:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f180031e00/0x27a633fcdd4a92e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940300.452454:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940300.452726:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1841b6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+13:3306:x1875839738193152:12345-0@lo:103: Request processed in 574us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940300.452734:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788940300.452806:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b48a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3306:1875839738193152:0@lo:103: 00000100:00100000:0.0:1788940300.456492:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18416f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+12:6703:x1875839738192896:12345-0@lo:253: Request processed in 22309us (22393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940300.456507:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788940300.456851:0:6703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4f64380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:6703:1875839738192896:0@lo:253: 10000000:01000000:1.0:1788940300.456866:0:6703:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788940300.456870:0:6703:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788940300.456872:0:6703:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788940300.456873:0:6703:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788940300.456875:0:6703:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788940300.456876:0:6703:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788940300.456877:0:6703:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788940300.456879:0:6703:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788940300.456880:0:6703:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788940300.456881:0:6703:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788940300.456883:0:6703:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788940300.456897:0:6703:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788940300.456915:0:6703:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788940300.462083:0:6703:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788940300.462272:0:6703:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788940300.462495:0:6703:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788940300.463251:0:6703:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788940300.463465:0:6703:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788940300.464118:0:6703:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788940300.465500:0:6703:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1788940300.732474:0:6703:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788940300.732481:0:6703:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788940300.732549:0:6703:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788940300.732612:0:6703:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.114@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788940300.732631:0:6703:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788940300.732660:0:6703:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1788940300.973805:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940301.998714:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940303.020786:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940304.044703:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940305.069100:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940305.901101:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4f64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3307:1875839738193280:0@lo:400: 00000100:00100000:1.0:1788940305.901192:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940305.901246:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788940305.901253:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4f65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875839738193408:0@lo:400: 00000100:00100000:1.0:1788940305.901280:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940305.901313:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4f64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875839738193536:0@lo:400: 00000100:00100000:1.0:1788940305.901339:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940305.901372:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738193280 00000100:00100000:1.0:1788940305.901381:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738193280 00000100:00100000:1.0:1788940305.901426:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788940305.901436:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18416e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+12:3307:x1875839738193280:12345-0@lo:400: 00000100:00100000:1.0:1788940305.901489:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18416e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+12:3307:x1875839738193280:12345-0@lo:400: Request processed in 55us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940305.901497:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788940305.901556:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738193408 00000100:00100000:1.0:1788940305.901560:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738193408 00000100:00100000:1.0:1788940305.901583:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738193536 00000100:00100000:1.0:1788940305.901587:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738193536 00000100:00100000:1.0:1788940305.901623:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788940305.901631:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875839738193408:12345-0@lo:400: 00000100:00100000:1.0:1788940305.901673:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875839738193408:12345-0@lo:400: Request processed in 43us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940305.901680:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788940305.901693:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788940305.901698:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875839738193536:12345-0@lo:400: 00000100:00100000:1.0:1788940305.902108:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875839738193536:12345-0@lo:400: Request processed in 408us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940305.902114:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788940305.902382:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89f1b4f64700 x1875839738193536/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940305.902396:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4f64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875839738193536:0@lo:400: 00010000:00080000:1.0:1788940305.902426:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89f1b4f65500 x1875839738193408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940305.902434:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4f65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875839738193408:0@lo:400: 00000100:00100000:1.0:1788940305.902443:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4f64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3307:1875839738193280:0@lo:400: 00000100:00080000:2.0:1788940305.903490:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788940306.092699:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940307.116695:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788940307.444576:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788940307.444585:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff89f188f09000 from 21 10000000:01000000:1.0:1788940307.444592:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788940307.444647:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f1c21f1e00/0x27a633fcdd4a935 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940307.444660:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f1c21f1e00/0x27a633fcdd4a935 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940307.444673:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f1c21f1e00/0x27a633fcdd4a935 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940307.444714:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4f64380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738193664:0@lo:101: 00000100:00100000:1.0:1788940307.444803:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940307.444864:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1863f00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788940307.449743:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738193664 00000100:00100000:0.0:1788940307.449762:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738193664 00000100:00100000:0.0:1788940307.449830:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788940307.449843:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18416f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+12:5858:x1875839738193664:12345-0@lo:101: 00010000:00010000:0.0:1788940307.449861:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940307.449879:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f180030c00/0x27a633fcdd4a93c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4a935 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940307.449908:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f180030c00/0x27a633fcdd4a93c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4a935 expref: 13 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940307.449919:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f180030c00/0x27a633fcdd4a93c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4a935 expref: 13 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940307.449929:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f180030c00, rc 0) 00000100:00100000:0.0:1788940307.450010:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18416f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+13:5858:x1875839738193664:12345-0@lo:101: Request processed in 171us (5207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940307.450016:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788940307.450185:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4f64380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738193664:0@lo:101: 00010000:00010000:1.0:1788940307.450208:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f1c21f1e00/0x27a633fcdd4a935 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4a93c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940307.450218:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f1c21f1e00/0x27a633fcdd4a935 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4a93c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940307.450299:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4f64380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738193792:0@lo:501: 00000100:00100000:1.0:1788940307.450337:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940307.450381:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1863f00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788940307.450896:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738193792 00000100:00100000:0.0:1788940307.450903:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738193792 00000100:00100000:0.0:1788940307.450943:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788940307.450951:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18416ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+13:5858:x1875839738193792:12345-0@lo:501: 00000100:00100000:0.0:1788940307.451236:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18416ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+13:5858:x1875839738193792:12345-0@lo:501: Request processed in 285us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940307.451243:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788940307.451281:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4f64380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738193792:0@lo:501: 00000100:00100000:0.0:1788940307.451313:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198181c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738193920:0@lo:503: 00000100:00100000:0.0:1788940307.451353:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940307.451374:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f0829006c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788940307.451386:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738193920 00000100:00100000:0.0:1788940307.451389:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738193920 00000100:00100000:0.0:1788940307.451410:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788940307.451416:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18416dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+13:5858:x1875839738193920:12345-0@lo:503: 00000100:00100000:0.0:1788940307.451601:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18416dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+13:5858:x1875839738193920:12345-0@lo:503: Request processed in 184us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940307.451608:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788940307.451644:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198181c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738193920:0@lo:503: 00000100:00100000:0.0:1788940307.451849:0:7030:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198181c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:7030:1875839738194048:0@lo:502: 00000100:00100000:0.0:1788940307.451882:0:7030:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940307.451899:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738194048 00000100:00100000:0.0:1788940307.451903:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738194048 00000100:00100000:0.0:1788940307.451922:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788940307.451928:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18416c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+13:7030:x1875839738194048:12345-0@lo:502: 00000100:00100000:0.0:1788940307.452081:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18416c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+13:7030:x1875839738194048:12345-0@lo:502: Request processed in 152us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940307.452087:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788940307.452115:0:7030:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f082900480 going to sleep for 11 seconds 00000100:00100000:0.0:1788940307.452128:0:7030:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198181c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:7030:1875839738194048:0@lo:502: 00000100:00100000:0.0:1788940307.452180:0:7030:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198181c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:7030:1875839738194176:0@lo:502: 00000100:00100000:0.0:1788940307.452212:0:7030:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940307.452229:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738194176 00000100:00100000:0.0:1788940307.452234:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738194176 00000100:00100000:0.0:1788940307.452252:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788940307.452264:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18416e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+13:7030:x1875839738194176:12345-0@lo:502: 00000100:00100000:0.0:1788940307.452373:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18416e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+13:7030:x1875839738194176:12345-0@lo:502: Request processed in 109us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940307.452379:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788940307.452406:0:7030:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f082900480 going to sleep for 11 seconds 00000100:00100000:0.0:1788940307.452419:0:7030:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198181c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:7030:1875839738194176:0@lo:502: 00000040:00080000:0.0:1788940307.452438:0:7030:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1788940307.452488:0:5858:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1788940307.452505:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788940307.452514:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f1c21f1e00/0x27a633fcdd4a935 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4a93c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940307.452548:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f1c21f1e00/0x27a633fcdd4a935 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4a93c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940307.452558:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788940307.452561:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff89f188f09000 from 4 10000000:01000000:0.0:1788940307.452564:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788940307.452590:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f180031e00/0x27a633fcdd4a943 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940307.452599:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f180031e00/0x27a633fcdd4a943 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940307.452609:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f180031e00/0x27a633fcdd4a943 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940307.452621:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198181c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738194304:0@lo:101: 00000100:00100000:0.0:1788940307.452647:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940307.452668:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1980993c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788940307.452679:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738194304 00000100:00100000:0.0:1788940307.452683:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738194304 00000100:00100000:0.0:1788940307.452705:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788940307.452712:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18416c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+13:5858:x1875839738194304:12345-0@lo:101: 00010000:00010000:0.0:1788940307.452720:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940307.452732:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f180031a00/0x27a633fcdd4a94a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4a943 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940307.452752:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f180031a00/0x27a633fcdd4a94a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4a943 expref: 14 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940307.452763:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f180031a00/0x27a633fcdd4a94a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4a943 expref: 14 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940307.452771:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f180031a00, rc 0) 00000100:00100000:0.0:1788940307.452800:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18416c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+14:5858:x1875839738194304:12345-0@lo:101: Request processed in 88us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940307.452806:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788940307.452837:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198181c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738194304:0@lo:101: 00010000:00010000:0.0:1788940307.452848:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f180031e00/0x27a633fcdd4a943 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4a94a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940307.452857:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f180031e00/0x27a633fcdd4a943 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4a94a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940307.452898:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198181c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738194432:0@lo:256: 00000100:00100000:0.0:1788940307.452929:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940307.452942:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1980993c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788940307.452959:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738194432 00000100:00100000:0.0:1788940307.452962:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738194432 00000100:00100000:0.0:1788940307.452982:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788940307.452989:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18416e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+14:5858:x1875839738194432:12345-0@lo:256: 20000000:01000000:0.0:1788940307.453000:0:5853:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788940307.453016:0:5853:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788940307.453019:0:5853:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1788940307.453095:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18416e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+14:5858:x1875839738194432:12345-0@lo:256: Request processed in 106us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940307.453103:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788940307.453134:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198181c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738194432:0@lo:256: 10000000:01000000:0.0:1788940307.453182:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788940307.453187:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f180031e00/0x27a633fcdd4a943 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4a94a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940307.453195:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f180031e00/0x27a633fcdd4a943 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4a94a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940307.453201:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788940307.453203:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1788940307.453205:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788940307.453221:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f180030000/0x27a633fcdd4a951 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940307.453227:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f180030000/0x27a633fcdd4a951 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940307.453235:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f180030000/0x27a633fcdd4a951 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940307.453257:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198181c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738194560:0@lo:101: 00000100:00100000:0.0:1788940307.453281:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940307.453293:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1980993c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788940307.453303:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738194560 00000100:00100000:0.0:1788940307.453306:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738194560 00000100:00100000:0.0:1788940307.453321:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788940307.453326:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18416fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+14:5858:x1875839738194560:12345-0@lo:101: 00010000:00010000:0.0:1788940307.453331:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940307.453338:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f180030400/0x27a633fcdd4a958 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4a951 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940307.453351:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f180030400/0x27a633fcdd4a958 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4a951 expref: 15 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940307.453359:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f180030400/0x27a633fcdd4a958 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4a951 expref: 15 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940307.453366:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f180030400, rc 0) 00000100:00100000:0.0:1788940307.453390:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18416fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+15:5858:x1875839738194560:12345-0@lo:101: Request processed in 63us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940307.453395:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788940307.453423:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198181c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738194560:0@lo:101: 00010000:00010000:0.0:1788940307.453433:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f180030000/0x27a633fcdd4a951 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4a958 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940307.453440:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f180030000/0x27a633fcdd4a951 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4a958 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940307.453488:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198181c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738194688:0@lo:501: 00000100:00100000:0.0:1788940307.453509:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940307.453543:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f082900000 going to sleep for 11 seconds 00000100:00100000:0.0:1788940307.453553:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738194688 00000100:00100000:0.0:1788940307.453555:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738194688 00000100:00100000:0.0:1788940307.453574:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788940307.453579:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18416d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+15:5858:x1875839738194688:12345-0@lo:501: 00000100:00100000:0.0:1788940307.453787:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18416d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+15:5858:x1875839738194688:12345-0@lo:501: Request processed in 206us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940307.453793:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788940307.453823:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198181c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738194688:0@lo:501: 00000100:00100000:0.0:1788940307.453848:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198181c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738194816:0@lo:503: 00000100:00100000:0.0:1788940307.453882:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940307.453895:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f082900000 going to sleep for 11 seconds 00000100:00100000:0.0:1788940307.453905:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738194816 00000100:00100000:0.0:1788940307.453908:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738194816 00000100:00100000:0.0:1788940307.453928:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788940307.453933:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18416cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+15:5858:x1875839738194816:12345-0@lo:503: 00000100:00100000:0.0:1788940307.454132:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18416cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+15:5858:x1875839738194816:12345-0@lo:503: Request processed in 198us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940307.454138:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788940307.460916:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198181c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738194816:0@lo:503: 00000100:00100000:1.0:1788940307.462512:0:7031:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4f65500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:7031:1875839738194944:0@lo:502: 00000100:00100000:1.0:1788940307.462618:0:7031:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940307.462662:0:7031:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1863f00c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788940307.462799:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738194944 00000100:00100000:3.0:1788940307.462808:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738194944 00000100:00100000:3.0:1788940307.462868:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788940307.462880:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f188d36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+15:7031:x1875839738194944:12345-0@lo:502: 00000100:00100000:3.0:1788940307.463161:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f188d36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+15:7031:x1875839738194944:12345-0@lo:502: Request processed in 282us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940307.463170:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788940307.463259:0:7031:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4f65500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:7031:1875839738194944:0@lo:502: 00000020:01000000:1.0:1788940307.463285:0:7031:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788940307.463293:0:7031:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788940307.463300:0:7031:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940307.463302:0:7031:0:(obd_config.c:1662:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788940307.463307:0:7031:0:(obd_config.c:1571:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788940307.463311:0:7031:0:(obd_config.c:1586:class_process_config()) adding mapping from uuid 192.168.202.114@tcp to nid 0x20000c0a8ca72 (192.168.202.114@tcp) 00000020:01000000:1.0:1788940307.463333:0:7031:0:(obd_config.c:2073:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788940307.463336:0:7031:0:(obd_config.c:1571:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788940307.463350:0:7031:0:(genops.c:415:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff89f1b5180000) 00000020:00000080:1.0:1788940307.463375:0:7031:0:(obd_config.c:786:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1788940307.463381:0:7031:0:(obd_config.c:1571:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788940307.463460:0:7031:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788940307.463465:0:7031:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788940307.463472:0:7031:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x27a633fcdd4a966 00010000:00080000:1.0:1788940307.463499:0:7031:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89f1ae830000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.114@tcp at head 00010000:00010000:1.0:1788940307.463756:0:7031:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1788940307.544046:0:7031:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1788940307.544068:0:7031:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788940307.544670:0:7031:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788940307.544832:0:7031:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788940307.544881:0:7031:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1788940307.544937:0:7031:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1788940307.545570:0:7036:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788940307.545575:0:7036:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788940307.546361:0:7031:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788940307.546374:0:7031:0:(obd_config.c:1571:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788940307.546407:0:7031:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788940307.546429:0:7031:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x27a633fcdd4a96d 00000100:00080000:1.0:1788940307.546442:0:7031:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788940307.546448:0:7031:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff89f1ae830000 using connection 192.168.202.114@tcp/0@lo 00000100:00100000:1.0:1788940307.546506:0:7031:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89f1b4f65500 x1875839738195072/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788940307.546613:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4f65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875839738195072:0@lo:8: 00000100:00100000:0.0:1788940307.546700:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788940307.546884:0:7031:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1788940307.546956:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4f64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875839738195200:0@lo:400: 00000100:00100000:1.0:1788940307.546987:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940307.547023:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4f65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875839738195328:0@lo:400: 00000100:00100000:1.0:1788940307.547044:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940307.547078:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738195200 00000100:00100000:1.0:1788940307.547093:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738195200 00000100:00100000:1.0:1788940307.547133:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738195328 00000100:00100000:1.0:1788940307.547136:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738195328 00000100:00100000:1.0:1788940307.547174:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788940307.547183:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875839738195200:12345-0@lo:400: 00000100:00100000:1.0:1788940307.547236:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875839738195200:12345-0@lo:400: Request processed in 53us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940307.547243:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788940307.547257:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788940307.547263:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875839738195328:12345-0@lo:400: 00000100:00100000:1.0:1788940307.547293:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875839738195328:12345-0@lo:400: Request processed in 30us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940307.547298:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1788940307.547323:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788940307.547348:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89f1b4f65880 x1875839738195328/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940323 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940307.547363:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4f65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875839738195328:0@lo:400: 00010000:00080000:1.0:1788940307.547389:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89f1b4f64700 x1875839738195200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940323 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940307.547397:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4f64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875839738195200:0@lo:400: 00000020:01000000:1.0:1788940307.547451:0:7031:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788940307.547456:0:7031:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940307.547459:0:7031:0:(obd_config.c:1662:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788940307.547462:0:7031:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788940307.547467:0:7031:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940307.547468:0:7031:0:(obd_config.c:1662:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788940307.547471:0:7031:0:(obd_config.c:1571:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788940307.547473:0:7031:0:(obd_config.c:1636:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788940307.547504:0:7031:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4f64700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:7031:1875839738195456:0@lo:502: 00000100:00100000:1.0:1788940307.547565:0:7031:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940307.547586:0:7031:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f186823000 going to sleep for 11 seconds 00000100:00100000:0.0:1788940307.554614:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738195072 00000100:00100000:0.0:1788940307.554631:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738195072 00000100:00100000:0.0:1788940307.554687:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788940307.554698:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f198181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3304:x1875839738195072:12345-0@lo:8: 00010000:00080000:0.0:1788940307.554730:0:6705:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 250 last 0 00000020:00000080:0.0:1788940307.554767:0:6705:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x27a633fcdd4a974 00002000:00100000:0.0:1788940307.554808:0:6705:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff89f1aeedb000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788940307.554813:0:6705:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:0.0:1788940307.554817:0:6705:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1788940307.554937:0:6705:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788940307.555081:0:6705:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788940307.555111:0:6705:0:(import.c:65:import_set_state_nolock()) ffff89f1aeede800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788940307.555223:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f198181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1875839738195072:12345-0@lo:8: Request processed in 525us (8521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940307.555231:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788940307.555259:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738195456 00000100:00100000:0.0:1788940307.555264:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738195456 00000100:00100000:0.0:1788940307.555293:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788940307.555299:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f188d37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+15:7031:x1875839738195456:12345-0@lo:502: 00000100:00100000:0.0:1788940307.555551:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f188d37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+15:7031:x1875839738195456:12345-0@lo:502: Request processed in 251us (7985us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940307.555557:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:2.0:1788940307.555584:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89f1b4f65500 x1875839738195072/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788940317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940307.555596:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00100000:0.0:1788940307.555643:0:7031:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4f64700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:7031:1875839738195456:0@lo:502: 00000020:01000000:0.0:1788940307.555676:0:7031:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788940307.555682:0:7031:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940307.555684:0:7031:0:(obd_config.c:1662:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788940307.555689:0:7031:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:0.0:1788940307.555753:0:5858:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1788940307.555771:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788940307.555781:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f180030000/0x27a633fcdd4a951 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4a958 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940307.555791:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f180030000/0x27a633fcdd4a951 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4a958 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940307.555801:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788940307.555803:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff89f1982e0000 from 1 10000000:01000000:0.0:1788940307.555806:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788940307.555837:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f180031600/0x27a633fcdd4a97b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940307.555844:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f180031600/0x27a633fcdd4a97b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940307.555853:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f180031600/0x27a633fcdd4a97b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940307.555870:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198181f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738195584:0@lo:101: 00000100:00100000:0.0:1788940307.555906:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940307.555939:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f190120c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788940307.555954:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738195584 00000100:00100000:0.0:1788940307.555958:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738195584 00000100:00100000:0.0:1788940307.555980:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788940307.555987:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f188d36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+15:5858:x1875839738195584:12345-0@lo:101: 00010000:00010000:0.0:1788940307.555996:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:2.0:1788940307.556012:0:3304:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00010000:00010000:0.0:1788940307.556018:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f082ad2000/0x27a633fcdd4a982 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4a97b expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788940307.556021:0:3304:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788940307.556028:0:3304:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788940307.556030:0:3304:0:(import.c:65:import_set_state_nolock()) ffff89f1ae830000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788940307.556043:0:3304:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788940307.556048:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4f65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875839738195072:0@lo:8: 00010000:00010000:0.0:1788940307.556049:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f082ad2000/0x27a633fcdd4a982 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4a97b expref: 16 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940307.556059:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f082ad2000/0x27a633fcdd4a982 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4a97b expref: 16 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940307.556067:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f082ad2000, rc 0) 00000100:00100000:0.0:1788940307.556099:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f188d36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+16:5858:x1875839738195584:12345-0@lo:101: Request processed in 112us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940307.556105:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788940307.556136:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198181f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738195584:0@lo:101: 00010000:00010000:0.0:1788940307.556160:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f180031600/0x27a633fcdd4a97b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4a982 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940307.556169:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f180031600/0x27a633fcdd4a97b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4a982 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940307.556211:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198181f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738195712:0@lo:501: 00000100:00100000:0.0:1788940307.556235:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940307.556247:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f190120c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788940307.556259:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738195712 00000100:00100000:0.0:1788940307.556262:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738195712 00000100:00100000:0.0:1788940307.556280:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788940307.556285:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1980ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+16:5858:x1875839738195712:12345-0@lo:501: 00000100:00100000:0.0:1788940307.556460:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1980ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+16:5858:x1875839738195712:12345-0@lo:501: Request processed in 173us (223us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788940307.556467:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788940307.556503:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198181f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738195712:0@lo:501: 10000000:01000000:0.0:1788940307.556539:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788940307.556544:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f180031600/0x27a633fcdd4a97b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4a982 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940307.556551:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f180031600/0x27a633fcdd4a97b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4a982 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788940307.558076:0:7036:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788940307.558283:0:7036:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 250456763199ns, next at 0ns, rc = 0 00000004:00080000:1.0:1788940307.652216:0:7037:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788940307.652254:0:7037:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4f64a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7037:1875839738195968:0@lo:7: 00000100:00100000:1.0:1788940307.652327:0:7037:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940307.652375:0:7037:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f186823840 going to sleep for 11 seconds 00000100:00100000:1.0:1788940307.652394:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4f65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738195840:0@lo:13: 00000100:00100000:1.0:1788940307.652419:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940307.652468:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738195968 00000100:00100000:1.0:1788940307.652477:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738195968 00000100:00100000:1.0:1788940307.652558:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788940307.652568:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7037:x1875839738195968:12345-0@lo:7: 00000100:00100000:1.0:1788940307.669267:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738195840 00000100:00100000:1.0:1788940307.669284:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738195840 00000100:00100000:1.0:1788940307.669353:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788940307.669366:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1875839738195840:12345-0@lo:13: 00002000:00000024:1.0:1788940307.669404:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1788940307.669500:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1875839738195840:12345-0@lo:13: Request processed in 137us (17079us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940307.669508:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788940307.669556:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788940307.669617:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89f1b4f65880 x1875839738195840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940323 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940307.669640:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4f65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738195840:0@lo:13: 00002000:00080000:1.0:1788940307.685355:0:6708:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1788940307.685364:0:6708:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1788940307.685469:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7037:x1875839738195968:12345-0@lo:7: Request processed in 32899us (33138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940307.685490:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788940307.685583:0:7037:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89f1b4f64a80 x1875839738195968/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788940323 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940307.685600:0:7037:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4f64a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7037:1875839738195968:0@lo:7: 00000004:00080000:1.0:1788940307.685615:0:7037:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1788940307.685661:0:7037:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4f64a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7037:1875839738196096:0@lo:5: 00000100:00100000:1.0:1788940307.685698:0:7037:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940307.685744:0:7037:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f186823840 going to sleep for 11 seconds 00000100:00100000:1.0:1788940307.685765:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738196096 00000100:00100000:1.0:1788940307.685772:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738196096 00000100:00100000:1.0:1788940307.685821:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788940307.685830:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7037:x1875839738196096:12345-0@lo:5: 00002000:00080000:1.0:1788940307.685859:0:6705:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788940307.685862:0:6705:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1788940307.686055:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:7037:x1875839738196096:12345-0@lo:5: Request processed in 226us (355us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788940307.686061:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788940307.686088:0:7037:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89f1b4f64a80 x1875839738196096/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788940323 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940307.686100:0:7037:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4f64a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7037:1875839738196096:0@lo:5: 00000004:00080000:1.0:1788940307.686108:0:7037:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788940307.686130:0:7037:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4f66300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7037:1875839738196224:0@lo:700: 00000100:00100000:1.0:1788940307.686167:0:7037:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940307.686191:0:7037:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f186823840 going to sleep for 11 seconds 00000100:00100000:0.0:1788940307.695087:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738196224 00000100:00100000:0.0:1788940307.695106:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738196224 00000100:00100000:0.0:1788940307.695174:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788940307.695187:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7037:x1875839738196224:12345-0@lo:700: 00000100:00100000:0.0:1788940307.695255:0:6714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198181f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6714:1875839738196352:0@lo:700: 00000100:00100000:0.0:1788940307.695320:0:6714:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940307.695348:0:6714:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1863f06c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788940307.695374:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738196352 00000100:00100000:0.0:1788940307.695378:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738196352 00000100:00100000:0.0:1788940307.695403:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788940307.695409:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f198180e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6714:x1875839738196352:12345-0@lo:700: 00000004:00080000:2.0:1788940307.740580:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 40000000:02000000:0.0:1788940307.807864:0:5867:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:1.0:1788940307.812704:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f198180e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6714:x1875839738196352:12345-0@lo:700: Request processed in 117285us (117373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940307.812738:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788940307.813801:0:6714:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89f198181f80 x1875839738196352/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788940323 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940307.813819:0:6714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198181f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6714:1875839738196352:0@lo:700: 40000000:02000000:0.0:1788940307.813835:0:6714:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:1.0:1788940307.954245:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7037:x1875839738196224:12345-0@lo:700: Request processed in 259055us (268071us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940307.954290:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788940307.954765:0:7037:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89f1b4f66300 x1875839738196224/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788940323 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940307.954784:0:7037:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4f66300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7037:1875839738196224:0@lo:700: 00000001:00100000:3.0:1788940307.957272:0:6732:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788940307.957297:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000004:02000040:2.0:1788940308.022709:0:7037:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1788940308.035920:0:7037:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4f64e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7037:1875839738196480:0@lo:5: 00000100:00100000:1.0:1788940308.035997:0:7037:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940308.036057:0:7037:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f186823780 going to sleep for 11 seconds 00000100:00100000:2.0:1788940308.036717:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738196480 00000100:00100000:2.0:1788940308.036728:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738196480 00000100:00100000:2.0:1788940308.036791:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788940308.036798:0:6707:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788940308.036802:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:7037:x1875839738196480:12345-0@lo:5: 00000100:00100000:3.0:1788940308.036807:0:6707:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00002000:00080000:3.0:1788940308.047480:0:6705:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1788940308.047515:0:6705:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:3.0:1788940308.049990:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7037:x1875839738196480:12345-0@lo:5: Request processed in 13183us (13988us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788940308.050008:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788940308.050603:0:7037:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89f1b4f64e00 x1875839738196480/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788940324 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940308.050630:0:7037:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788940308.050655:0:7037:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff89f1b4f64e00 x1875839738196480/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788940324 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940308.050667:0:7037:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4f64e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7037:1875839738196480:0@lo:5: 00000004:00080000:0.0:1788940308.050684:0:7037:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00000001:02000400:2.0:1788940308.079874:0:7078:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg214-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788940308.140858:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940309.165470:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940310.189036:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940311.215146:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940312.237995:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940312.556888:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788940312.557151:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b48a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875839738196736:0@lo:400: 00000100:00100000:0.0:1788940312.557231:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940312.557330:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b48a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3306:1875839738196608:0@lo:400: 00000100:00100000:0.0:1788940312.557364:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940312.557401:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738196608 00000100:00100000:2.0:1788940312.557447:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738196608 00000100:00100000:2.0:1788940312.557502:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788940312.557509:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b48a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875839738196864:0@lo:400: 00000100:00100000:2.0:1788940312.557512:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1980dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+16:3306:x1875839738196608:12345-0@lo:400: 00000100:00100000:3.0:1788940312.557568:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940312.557592:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1980dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+16:3306:x1875839738196608:12345-0@lo:400: Request processed in 80us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940312.557600:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788940312.557620:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b48a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3306:1875839738196608:0@lo:400: 00000100:00100000:3.0:1788940312.557870:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788940312.557877:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b48a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738196992:0@lo:400: 00000100:00100000:3.0:1788940312.557922:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940312.557964:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738196992 00000100:00100000:2.0:1788940312.557969:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738196992 00000100:00100000:2.0:1788940312.558018:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788940312.558025:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b48a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1875839738196992:12345-0@lo:400: 00000100:00080000:3.0:1788940312.558032:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788940312.558080:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738196736 00000100:00100000:2.0:1788940312.558082:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b48a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1875839738196992:12345-0@lo:400: Request processed in 58us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940312.558084:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738196736 00000100:00100000:2.0:1788940312.558089:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788940312.558122:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738196864 00000100:00100000:1.0:1788940312.558125:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738196864 00000100:00100000:1.0:1788940312.558155:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788940312.558162:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f198181f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875839738196736:12345-0@lo:400: 00000100:00100000:1.0:1788940312.558201:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f198181f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875839738196736:12345-0@lo:400: Request processed in 40us (969us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940312.558207:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788940312.558220:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788940312.558226:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b48a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875839738196864:12345-0@lo:400: 00000100:00100000:1.0:1788940312.558251:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b48a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875839738196864:12345-0@lo:400: Request processed in 26us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940312.558257:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1788940312.558286:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788940312.558288:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89f1b48a6a00 x1875839738196736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940312.558302:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b48a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875839738196736:0@lo:400: 00010000:00080000:3.0:1788940312.558369:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89f1b48a4e00 x1875839738196992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940312.558380:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b48a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738196992:0@lo:400: 00010000:00080000:3.0:1788940312.558390:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89f1b48a6300 x1875839738196864/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940312.558397:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b48a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875839738196864:0@lo:400: 00000001:00080000:3.0:1788940312.790646:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000100:00100000:3.0:1788940313.069717:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b48a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738197120:0@lo:13: 00000100:00100000:3.0:1788940313.069872:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940313.069955:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738197120 00000100:00100000:3.0:1788940313.069965:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738197120 00000100:00100000:3.0:1788940313.070015:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788940313.070025:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b48a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738197120:12345-0@lo:13: 00002000:00000024:3.0:1788940313.070062:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788940313.070408:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b48a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738197120:12345-0@lo:13: Request processed in 384us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940313.070427:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788940313.070468:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89f1b48a6300 x1875839738197120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940329 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940313.072563:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788940313.072606:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b48a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738197120:0@lo:13: 00010000:00010000:3.0:1788940313.260932:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940314.286131:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940315.310950:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940316.339227:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940317.359636:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940317.677753:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4f67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3306:1875839738197248:0@lo:400: 00000100:00100000:1.0:1788940317.677878:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940317.677957:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788940317.677967:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4f66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738197632:0@lo:400: 00000100:00100000:1.0:1788940317.678003:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940317.678697:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4f64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875839738197376:0@lo:400: 00000100:00100000:1.0:1788940317.680632:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940317.680715:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788940317.680727:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4f64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875839738197504:0@lo:400: 00000100:00100000:1.0:1788940317.680790:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940317.680840:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738197376 00000100:00100000:1.0:1788940317.680848:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738197376 00000100:00100000:1.0:1788940317.680901:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738197504 00000100:00100000:1.0:1788940317.680905:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738197504 00000100:00100000:1.0:1788940317.680939:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788940317.680949:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4cd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875839738197376:12345-0@lo:400: 00000100:00100000:1.0:1788940317.681011:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4cd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875839738197376:12345-0@lo:400: Request processed in 63us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940317.681019:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788940317.681035:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788940317.681042:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4cd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875839738197504:12345-0@lo:400: 00000100:00100000:1.0:1788940317.681083:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4cd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875839738197504:12345-0@lo:400: Request processed in 41us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940317.681089:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1788940317.681112:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788940317.681146:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89f1b4f64a80 x1875839738197504/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940317.681163:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4f64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875839738197504:0@lo:400: 00010000:00080000:1.0:1788940317.681192:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89f1b4f64e00 x1875839738197376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940317.681202:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4f64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875839738197376:0@lo:400: 00000100:00100000:1.0:1788940317.681592:0:7074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738197632 00000100:00100000:1.0:1788940317.681598:0:7074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738197632 00000100:00100000:1.0:1788940317.681642:0:7074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788940317.681649:0:7074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738197632:12345-0@lo:400: 00000100:00100000:1.0:1788940317.681700:0:7074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738197632:12345-0@lo:400: Request processed in 52us (3698us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940317.681706:0:7074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788940317.681726:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738197248 00000100:00100000:1.0:1788940317.681730:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738197248 00000100:00100000:1.0:1788940317.681757:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788940317.681764:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1980de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+16:3306:x1875839738197248:12345-0@lo:400: 00000100:00100000:1.0:1788940317.681798:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1980de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+16:3306:x1875839738197248:12345-0@lo:400: Request processed in 35us (3924us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940317.681805:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:1.0:1788940317.681843:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788940317.681867:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89f1b4f66300 x1875839738197632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940317.681879:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4f66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738197632:0@lo:400: 00000100:00100000:1.0:1788940317.681893:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4f67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3306:1875839738197248:0@lo:400: 00000100:00100000:2.0:1788940318.200289:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788940318.200323:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738197760:0@lo:13: 00000100:00100000:2.0:1788940318.200414:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940318.200594:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738197760 00000100:00100000:2.0:1788940318.200603:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738197760 00000100:00100000:2.0:1788940318.200658:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788940318.200668:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738197760:12345-0@lo:13: 00002000:00000024:2.0:1788940318.200714:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788940318.200771:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738197760:12345-0@lo:13: Request processed in 105us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940318.200779:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788940318.201011:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89f1b5c6ed80 x1875839738197760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940334 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940318.201104:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738197760:0@lo:13: 00010000:00010000:3.0:1788940318.380759:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940319.405049:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788940320.107100:0:7642:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788940320.107104:0:7642:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1788940320.107193:0:7642:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff89f1bf721000 00000020:01000004:2.0:1788940320.107209:0:7642:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788940320.107220:0:7642:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1788940320.107232:0:7642:0:(genops.c:415:class_newdev()) Allocate new device lustre-OST0001-osd (ffff89f1980199d8) 00000020:00000080:2.0:1788940320.107244:0:7642:0:(obd_config.c:786:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788940320.118612:0:7642:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788940320.118778:0:7642:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1788940320.136678:0:7642:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788940320.142166:0:7642:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788940320.142198:0:7642:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788940320.142253:0:7642:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788940320.142277:0:7642:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788940320.142851:0:7642:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788940320.142864:0:7642:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788940320.142876:0:7642:0:(genops.c:1393:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x27a633fcdd4a990 00000020:01000004:3.0:1788940320.142884:0:7642:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1788940320.142905:0:7642:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.114@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788940320.142908:0:7642:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.114@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788940320.142914:0:7642:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788940320.142946:0:7642:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1788940320.142950:0:7642:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.114@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1788940320.161748:0:7642:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.114@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788940320.161777:0:7642:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.114@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1788940320.161780:0:7642:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788940320.161781:0:7642:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788940320.161782:0:7642:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788940320.161783:0:7642:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788940320.161783:0:7642:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788940320.161784:0:7642:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788940320.161785:0:7642:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788940320.161787:0:7642:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788940320.161787:0:7642:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788940320.161788:0:7642:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788940320.161789:0:7642:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788940320.161792:0:7642:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1788940320.161793:0:7642:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788940320.161794:0:7642:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788940320.161795:0:7642:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788940320.161796:0:7642:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788940320.161796:0:7642:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788940320.161799:0:7642:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788940320.161800:0:7642:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788940320.161800:0:7642:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788940320.161801:0:7642:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788940320.161802:0:7642:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788940320.161802:0:7642:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788940320.161830:0:7642:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788940320.161848:0:7642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198182300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:7642:1875839738197888:0@lo:253: 00000100:00100000:0.0:1788940320.161909:0:7642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940320.161956:0:7642:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1b4c12240 going to sleep for 11 seconds 00000100:00100000:2.0:1788940320.162168:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738197888 00000100:00100000:2.0:1788940320.162178:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738197888 00000100:00100000:2.0:1788940320.162238:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788940320.162249:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1980dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+16:7642:x1875839738197888:12345-0@lo:253: 20000000:01000000:2.0:1788940320.162278:0:5853:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788940320.162282:0:5853:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1788940320.162287:0:5853:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1788940320.162290:0:5853:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1788940320.163008:0:5853:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788940320.163232:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1788940320.163248:0:5853:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1788940320.163290:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1788940320.163298:0:5853:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1788940320.163329:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1788940320.163378:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1788940320.163717:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1788940320.163732:0:5853:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.114@tcp 20000000:01000000:2.0:1788940320.163734:0:5853:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.114@tcp (null) (null) (null) 00000040:00080000:2.0:1788940320.163752:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1788940320.163761:0:5853:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788940320.163791:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1788940320.163796:0:5853:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.114@tcp (null) (null) 00000040:00080000:2.0:1788940320.163811:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1788940320.163816:0:5853:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1788940320.163830:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1788940320.163854:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1788940320.164595:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:2.0:1788940320.164620:0:5853:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.114@tcp 20000000:01000000:2.0:1788940320.164622:0:5853:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.114@tcp (null) (null) (null) 00000040:00080000:2.0:1788940320.164656:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:2.0:1788940320.164663:0:5853:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788940320.164692:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:2.0:1788940320.164700:0:5853:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.114@tcp (null) (null) 00000040:00080000:2.0:1788940320.164732:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:2.0:1788940320.164737:0:5853:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1788940320.164763:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:2.0:1788940320.164782:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:2.0:1788940320.164792:0:5853:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:2.0:1788940320.164794:0:5853:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:2.0:1788940320.164798:0:5853:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788940320.164799:0:5853:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788940320.164801:0:5853:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788940320.164810:0:5853:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788940320.164812:0:5853:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788940320.164835:0:5853:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788940320.164837:0:5853:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788940320.166462:0:7644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1788940320.166793:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1788940320.166819:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1788940320.166861:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1788940320.166871:0:5853:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788940320.166872:0:5853:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788940320.167682:0:7645:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1788940320.167725:0:7645:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1788940320.167755:0:7645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1788940320.167995:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1788940320.168055:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1788940320.168094:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:0.0:1788940320.168104:0:5853:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788940320.168106:0:5853:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788940320.168673:0:7646:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1788940320.168721:0:7646:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1788940320.168776:0:7646:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1788940320.169002:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1788940320.169052:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1788940320.169119:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1788940320.169133:0:5853:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788940320.169135:0:5853:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788940320.169833:0:7647:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1788940320.169898:0:7647:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1788940320.169933:0:7647:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1788940320.170751:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1788940320.170801:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1788940320.170854:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:0.0:1788940320.170873:0:5853:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788940320.170893:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89f082ad3800/0x27a633fcdd4a997 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940320.170912:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89f180030a00/0x27a633fcdd4a8e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4a8e1 expref: 16 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940320.170933:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89f181521a00/0x27a633fcdd4a912 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4a90b expref: 16 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940320.170940:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89f180030c00/0x27a633fcdd4a93c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4a935 expref: 16 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940320.170946:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89f180030400/0x27a633fcdd4a958 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4a951 expref: 16 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940320.170952:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89f082ad2000/0x27a633fcdd4a982 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4a97b expref: 16 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940320.170959:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89f082ad3800/0x27a633fcdd4a997 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940320.170999:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89f082ad2000/0x27a633fcdd4a982 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27a633fcdd4a97b expref: 16 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940320.171016:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89f082ad2000/0x27a633fcdd4a982 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27a633fcdd4a97b expref: 16 pid: 5853 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940320.171043:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198182d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5853:1875839738198016:0@lo:104: 00000100:00100000:0.0:1788940320.171116:0:5853:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788940320.171167:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89f180030400/0x27a633fcdd4a958 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27a633fcdd4a951 expref: 16 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940320.171175:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89f180030400/0x27a633fcdd4a958 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27a633fcdd4a951 expref: 16 pid: 5853 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940320.171183:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198183b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5853:1875839738198144:0@lo:104: 00010000:00010000:0.0:1788940320.171221:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89f180030c00/0x27a633fcdd4a93c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27a633fcdd4a935 expref: 16 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940320.171230:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89f180030c00/0x27a633fcdd4a93c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27a633fcdd4a935 expref: 16 pid: 5854 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940320.171238:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198183800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5853:1875839738198272:0@lo:104: 00010000:00010000:0.0:1788940320.171261:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89f181521a00/0x27a633fcdd4a912 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27a633fcdd4a90b expref: 16 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940320.171269:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89f181521a00/0x27a633fcdd4a912 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27a633fcdd4a90b expref: 16 pid: 5854 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940320.171277:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198183100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5853:1875839738198400:0@lo:104: 00010000:00010000:0.0:1788940320.171299:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89f180030a00/0x27a633fcdd4a8e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27a633fcdd4a8e1 expref: 16 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940320.171307:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89f180030a00/0x27a633fcdd4a8e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27a633fcdd4a8e1 expref: 16 pid: 5854 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940320.171314:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198180a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5853:1875839738198528:0@lo:104: 00000100:00100000:0.0:1788940320.171331:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1b4c12480 going to sleep for 11 seconds 00000100:00100000:3.0:1788940320.171701:0:5844:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788940320.171722:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940320.171745:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940320.171753:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940320.171761:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940320.171771:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738198016 00000100:00100000:3.0:1788940320.171778:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738198016 00000100:00100000:3.0:1788940320.171833:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738198144 00000100:00100000:3.0:1788940320.171836:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738198144 00000100:00100000:3.0:1788940320.171848:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738198272 00000100:00100000:3.0:1788940320.171850:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738198272 00000100:00100000:3.0:1788940320.171859:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738198400 00000100:00100000:3.0:1788940320.171861:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738198400 00000100:00100000:3.0:1788940320.171868:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738198528 00000100:00100000:3.0:1788940320.171870:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738198528 00000100:00100000:3.0:1788940320.171884:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788940320.171893:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f188c5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+7:5853:x1875839738198016:12345-0@lo:104: 00010000:00010000:3.0:1788940320.171908:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff89f180031600/0x27a633fcdd4a97b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4a982 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940320.171969:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788940320.171975:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f188c5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+7:5853:x1875839738198016:12345-0@lo:104: Request processed in 83us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940320.171983:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788940320.172039:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788940320.172047:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b48a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+6:5853:x1875839738198144:12345-0@lo:104: 00010000:00010000:3.0:1788940320.172055:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff89f180030000/0x27a633fcdd4a951 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4a958 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940320.172100:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788940320.172105:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b48a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+6:5853:x1875839738198144:12345-0@lo:104: Request processed in 60us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940320.172111:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788940320.172125:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788940320.172131:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b48a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+5:5853:x1875839738198272:12345-0@lo:104: 00010000:00010000:3.0:1788940320.172139:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff89f1c21f1e00/0x27a633fcdd4a935 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4a93c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940320.172165:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788940320.172170:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b48a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+5:5853:x1875839738198272:12345-0@lo:104: Request processed in 40us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940320.172176:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788940320.172189:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788940320.172194:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b48a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+4:5853:x1875839738198400:12345-0@lo:104: 00010000:00010000:3.0:1788940320.172201:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff89f180031800/0x27a633fcdd4a90b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4a912 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940320.172226:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788940320.172230:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b48a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+4:5853:x1875839738198400:12345-0@lo:104: Request processed in 37us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940320.172235:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788940320.172246:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788940320.172252:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b48a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+3:5853:x1875839738198528:12345-0@lo:104: 00010000:00010000:3.0:1788940320.172260:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff89f181520c00/0x27a633fcdd4a8e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4a8e8 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940320.172295:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1788940320.172299:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b48a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+3:5853:x1875839738198528:12345-0@lo:104: Request processed in 48us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940320.172305:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1788940320.172972:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788940320.172978:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff89f180031600/0x27a633fcdd4a97b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4a982 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940320.172986:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f180031600 already unused, calling callback (ffffffffc1d10c20) 10000000:00010000:3.0:1788940320.172990:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff89f180031600/0x27a633fcdd4a97b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x27a633fcdd4a982 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940320.172999:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff89f180031600/0x27a633fcdd4a97b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x27a633fcdd4a982 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788940320.173007:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff89f180031600/0x27a633fcdd4a97b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x27a633fcdd4a982 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940320.173013:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1788940320.173144:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198182d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5853:1875839738198016:0@lo:104: 00000100:00100000:0.0:1788940320.173156:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198183b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5853:1875839738198144:0@lo:104: 00000100:00100000:0.0:1788940320.173164:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198183800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5853:1875839738198272:0@lo:104: 00000100:00100000:0.0:1788940320.173172:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198183100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5853:1875839738198400:0@lo:104: 00000100:00100000:0.0:1788940320.173180:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198180a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5853:1875839738198528:0@lo:104: 00010000:00010000:0.0:1788940320.173222:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89f082ad3800/0x27a633fcdd4a997 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940320.173298:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff89f180031600/0x27a633fcdd4a97b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4a982 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940320.173305:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788940320.173341:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff89f180031600/0x27a633fcdd4a97b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4a982 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940320.173499:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff89f180031600/0x27a633fcdd4a97b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4a982 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940320.173536:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788940320.173539:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff89f180030000/0x27a633fcdd4a951 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4a958 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940320.173543:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f180030000 already unused, calling callback (ffffffffc1d10c20) 10000000:00010000:3.0:1788940320.173546:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff89f180030000/0x27a633fcdd4a951 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x27a633fcdd4a958 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940320.173550:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff89f180030000/0x27a633fcdd4a951 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x27a633fcdd4a958 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788940320.173554:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff89f180030000/0x27a633fcdd4a951 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x27a633fcdd4a958 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940320.173557:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1788940320.173596:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b48a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3307:1875839738198656:0@lo:103: 00000100:00100000:0.0:1788940320.173632:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940320.173675:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738198656 00000100:00100000:0.0:1788940320.173680:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738198656 00010000:00010000:0.0:1788940320.173697:0:5845:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89f082ad2000/0x27a633fcdd4a982 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4a97b expref: 17 pid: 5853 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940320.173715:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788940320.173720:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f198180a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+17:3307:x1875839738198656:12345-0@lo:103: 00010000:00010000:0.0:1788940320.173729:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940320.173732:0:5845:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89f082ad2000/0x27a633fcdd4a982 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4a97b expref: 17 pid: 5853 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940320.173739:0:5845:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89f082ad2000/0x27a633fcdd4a982 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27a633fcdd4a97b expref: 17 pid: 5853 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940320.173748:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f082ad2000/0x27a633fcdd4a982 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27a633fcdd4a97b expref: 17 pid: 5853 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940320.173758:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940320.173776:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f198180a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+16:3307:x1875839738198656:12345-0@lo:103: Request processed in 57us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940320.173780:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788940320.173800:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b48a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3307:1875839738198656:0@lo:103: 00010000:00010000:2.0:1788940320.174592:0:5848:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788940320.174908:0:7648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788940320.174974:0:7649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940320.175035:0:7648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff89f180031800/0x27a633fcdd4a90b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4a912 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940320.175051:0:7648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f180031800 already unused, calling callback (ffffffffc1d10c20) 10000000:00010000:1.0:1788940320.175055:0:7648:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff89f180031800/0x27a633fcdd4a90b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x27a633fcdd4a912 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940320.175064:0:7648:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff89f180031800/0x27a633fcdd4a90b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x27a633fcdd4a912 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788940320.175071:0:7648:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff89f180031800/0x27a633fcdd4a90b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x27a633fcdd4a912 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940320.175077:0:7648:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788940320.175113:0:7648:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff89f180031800/0x27a633fcdd4a90b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4a912 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940320.175119:0:7648:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788940320.175132:0:7648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff89f180031800/0x27a633fcdd4a90b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4a912 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940320.175139:0:7648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff89f180031800/0x27a633fcdd4a90b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4a912 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940320.175150:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940320.175152:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940320.175153:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940320.175231:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4cd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3308:1875839738198784:0@lo:103: 00000100:00100000:0.0:1788940320.175275:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788940320.175314:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff89f1c21f1e00/0x27a633fcdd4a935 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4a93c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940320.175320:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1c21f1e00 already unused, calling callback (ffffffffc1d10c20) 10000000:00010000:0.0:1788940320.175323:0:5848:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff89f1c21f1e00/0x27a633fcdd4a935 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x27a633fcdd4a93c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940320.175330:0:5848:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff89f1c21f1e00/0x27a633fcdd4a935 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x27a633fcdd4a93c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788940320.175353:0:5848:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff89f1c21f1e00/0x27a633fcdd4a935 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x27a633fcdd4a93c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940320.175358:0:5848:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788940320.175377:0:5848:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff89f1c21f1e00/0x27a633fcdd4a935 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4a93c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940320.175384:0:5848:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788940320.175396:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff89f1c21f1e00/0x27a633fcdd4a935 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4a93c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940320.175400:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff89f1c21f1e00/0x27a633fcdd4a935 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4a93c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940320.175409:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940320.175410:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940320.175411:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940320.175421:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198183800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3305:1875839738198912:0@lo:103: 00000100:00100000:0.0:1788940320.175437:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940320.175468:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738198784 00000100:00100000:0.0:1788940320.175473:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738198784 00010000:00010000:0.0:1788940320.175495:0:5845:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89f181521a00/0x27a633fcdd4a912 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4a90b expref: 16 pid: 5854 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940320.175543:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738198912 00000100:00100000:0.0:1788940320.175546:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738198912 00010000:00010000:0.0:1788940320.175556:0:5845:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89f180030c00/0x27a633fcdd4a93c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4a935 expref: 17 pid: 5854 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940320.175566:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788940320.175571:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f198183100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+17:3308:x1875839738198784:12345-0@lo:103: 00010000:00010000:0.0:1788940320.175578:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940320.175581:0:5845:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89f181521a00/0x27a633fcdd4a912 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4a90b expref: 17 pid: 5854 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940320.175587:0:5845:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89f181521a00/0x27a633fcdd4a912 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27a633fcdd4a90b expref: 17 pid: 5854 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940320.175595:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f181521a00/0x27a633fcdd4a912 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27a633fcdd4a90b expref: 17 pid: 5854 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940320.175607:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940320.175630:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f198183100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+16:3308:x1875839738198784:12345-0@lo:103: Request processed in 59us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940320.175634:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788940320.175644:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788940320.175648:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f198183b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+15:3305:x1875839738198912:12345-0@lo:103: 00010000:00010000:0.0:1788940320.175652:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940320.175654:0:5845:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89f180030c00/0x27a633fcdd4a93c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4a935 expref: 15 pid: 5854 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940320.175664:0:5845:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89f180030c00/0x27a633fcdd4a93c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27a633fcdd4a935 expref: 15 pid: 5854 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940320.175670:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f180030c00/0x27a633fcdd4a93c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27a633fcdd4a935 expref: 15 pid: 5854 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940320.175676:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940320.175693:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f198183b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+14:3305:x1875839738198912:12345-0@lo:103: Request processed in 45us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940320.175696:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788940320.175719:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198183800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3305:1875839738198912:0@lo:103: 00000100:00100000:0.0:1788940320.175733:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4cd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3308:1875839738198784:0@lo:103: 00010000:00010000:3.0:1788940320.175890:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff89f180030000/0x27a633fcdd4a951 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4a958 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940320.175896:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788940320.175902:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff89f180030000/0x27a633fcdd4a951 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4a958 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940320.175906:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff89f180030000/0x27a633fcdd4a951 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4a958 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940320.175912:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940320.175913:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940320.175914:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940320.176013:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940320.176020:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940320.176034:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940320.176111:0:7649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff89f181520c00/0x27a633fcdd4a8e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4a8e8 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940320.176118:0:7649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f181520c00 already unused, calling callback (ffffffffc1d10c20) 10000000:00010000:1.0:1788940320.176122:0:7649:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff89f181520c00/0x27a633fcdd4a8e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x27a633fcdd4a8e8 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940320.176138:0:7649:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff89f181520c00/0x27a633fcdd4a8e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x27a633fcdd4a8e8 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788940320.176143:0:7649:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff89f181520c00/0x27a633fcdd4a8e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x27a633fcdd4a8e8 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940320.176148:0:7649:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788940320.176163:0:7649:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff89f181520c00/0x27a633fcdd4a8e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4a8e8 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940320.176168:0:7649:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788940320.176185:0:7649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff89f181520c00/0x27a633fcdd4a8e1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4a8e8 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940320.176190:0:7649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff89f181520c00/0x27a633fcdd4a8e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4a8e8 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940320.176200:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940320.176201:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940320.176202:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940320.176232:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b48a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3306:1875839738199040:0@lo:103: 00000100:00100000:0.0:1788940320.176257:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940320.176285:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788940320.176289:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4cd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3308:1875839738199168:0@lo:103: 00000100:00100000:0.0:1788940320.176302:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940320.176317:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738199040 00000100:00100000:0.0:1788940320.176320:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738199040 00000100:00100000:1.0:1788940320.176425:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738199168 00000100:00100000:1.0:1788940320.176428:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738199168 00010000:00010000:1.0:1788940320.176440:0:5845:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89f180030a00/0x27a633fcdd4a8e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4a8e1 expref: 15 pid: 5854 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940320.176454:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788940320.176458:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f198182d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+15:3308:x1875839738199168:12345-0@lo:103: 00010000:00010000:1.0:1788940320.176463:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940320.176465:0:5845:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89f180030a00/0x27a633fcdd4a8e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4a8e1 expref: 15 pid: 5854 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940320.176475:0:5845:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89f180030a00/0x27a633fcdd4a8e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27a633fcdd4a8e1 expref: 15 pid: 5854 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940320.176485:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f180030a00/0x27a633fcdd4a8e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27a633fcdd4a8e1 expref: 15 pid: 5854 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940320.176494:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940320.176549:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f198182d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+14:3308:x1875839738199168:12345-0@lo:103: Request processed in 90us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940320.176554:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:0.0:1788940320.176598:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89f180030400/0x27a633fcdd4a958 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4a951 expref: 13 pid: 5853 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940320.176616:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788940320.176621:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f198183800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+13:3306:x1875839738199040:12345-0@lo:103: 00010000:00010000:0.0:1788940320.176626:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940320.176628:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89f180030400/0x27a633fcdd4a958 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4a951 expref: 13 pid: 5853 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940320.176639:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89f180030400/0x27a633fcdd4a958 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27a633fcdd4a951 expref: 13 pid: 5853 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940320.176646:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f180030400/0x27a633fcdd4a958 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27a633fcdd4a951 expref: 13 pid: 5853 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940320.176655:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89f082ad3800/0x27a633fcdd4a997 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940320.176661:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f082ad3800/0x27a633fcdd4a997 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940320.176672:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89f082ad3800/0x27a633fcdd4a997 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940320.176676:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89f082ad3800/0x27a633fcdd4a997 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940320.176681:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89f082ad3800/0x27a633fcdd4a997 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940320.176686:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89f082ad3800/0x27a633fcdd4a997 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940320.176689:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad3800 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:0.0:1788940320.176691:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89f082ad3800/0x27a633fcdd4a997 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940320.176695:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89f082ad3800/0x27a633fcdd4a997 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940320.176722:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89f082ad3800/0x27a633fcdd4a997 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940320.176730:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940320.176748:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f198183800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+12:3306:x1875839738199040:12345-0@lo:103: Request processed in 128us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940320.176752:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788940320.176769:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b48a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3306:1875839738199040:0@lo:103: 00000100:00100000:0.0:1788940320.176782:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4cd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3308:1875839738199168:0@lo:103: 00010000:00010000:0.0:1788940320.176792:0:5853:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89f082ad3800/0x27a633fcdd4a997 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940320.176798:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89f082ad3800/0x27a633fcdd4a997 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940320.176802:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f082ad3800/0x27a633fcdd4a997 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788940320.176810:0:5853:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788940320.202772:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1980dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+11:7642:x1875839738197888:12345-0@lo:253: Request processed in 40516us (40852us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940320.202788:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788940320.202800:0:7642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198182300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:7642:1875839738197888:0@lo:253: 10000000:01000000:0.0:1788940320.202815:0:7642:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788940320.202818:0:7642:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788940320.202820:0:7642:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788940320.202821:0:7642:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788940320.202823:0:7642:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1788940320.202824:0:7642:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788940320.202826:0:7642:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788940320.202827:0:7642:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788940320.202829:0:7642:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788940320.202843:0:7642:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788940320.202844:0:7642:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788940320.202863:0:7642:0:(tgt_mount.c:101:server_register_mount()) register mount ffff89f1bf721000 from lustre-OST0001 10000000:01000000:0.0:1788940320.202885:0:7642:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788940320.202887:0:7642:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788940320.202893:0:7642:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff89f1982e0000 local copy 10000000:01000000:0.0:1788940320.202896:0:7642:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788940320.202928:0:7642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f082ad3800/0x27a633fcdd4a99e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940320.202936:0:7642:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.114@tcp lock: ffff89f082ad3800/0x27a633fcdd4a99e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940320.202943:0:7642:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f082ad3800/0x27a633fcdd4a99e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940320.202957:0:7642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198182300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:7642:1875839738199296:0@lo:101: 00000100:00100000:0.0:1788940320.202985:0:7642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940320.203110:0:7642:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f082900d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788940320.203152:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738199296 00000100:00100000:1.0:1788940320.203158:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738199296 00000100:00100000:1.0:1788940320.203220:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788940320.203228:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1980de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+11:7642:x1875839738199296:12345-0@lo:101: 00010000:00010000:1.0:1788940320.203238:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940320.203248:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f1c21f0e00/0x27a633fcdd4a9a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4a99e expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940320.203268:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f1c21f0e00/0x27a633fcdd4a9a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4a99e expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940320.203277:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f1c21f0e00/0x27a633fcdd4a9a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4a99e expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940320.203283:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f1c21f0e00, rc 0) 00000100:00100000:1.0:1788940320.203316:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1980de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+12:7642:x1875839738199296:12345-0@lo:101: Request processed in 89us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940320.203321:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788940320.203677:0:7642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198182300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:7642:1875839738199296:0@lo:101: 00010000:00010000:2.0:1788940320.203688:0:7642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f082ad3800/0x27a633fcdd4a99e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x27a633fcdd4a9a5 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940320.203695:0:7642:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f082ad3800/0x27a633fcdd4a99e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x27a633fcdd4a9a5 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940320.203771:0:7642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:7642:1875839738199424:0@lo:501: 00000100:00100000:2.0:1788940320.203794:0:7642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940320.203818:0:7642:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1a973e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788940320.203833:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738199424 00000100:00100000:3.0:1788940320.203837:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738199424 00000100:00100000:3.0:1788940320.203871:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788940320.203878:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1980dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+13:7642:x1875839738199424:12345-0@lo:501: 00000100:00100000:3.0:1788940320.204093:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1980dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+12:7642:x1875839738199424:12345-0@lo:501: Request processed in 215us (296us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788940320.204100:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788940320.204284:0:7642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:7642:1875839738199424:0@lo:501: 10000000:01000000:2.0:1788940320.204298:0:7642:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.114@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788940320.204318:0:7642:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.114@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788940320.204323:0:7642:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f082ad3800/0x27a633fcdd4a99e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x27a633fcdd4a9a5 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940320.204427:0:7642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f082ad3800/0x27a633fcdd4a99e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x27a633fcdd4a9a5 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940320.204432:0:7642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.114@tcp lock: ffff89f082ad3800/0x27a633fcdd4a99e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x27a633fcdd4a9a5 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940320.204449:0:7642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788940320.204467:0:7642:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff89f1bf721000 10000000:01000000:2.0:1788940320.204470:0:7642:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788940320.204474:0:7642:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788940320.204476:0:7642:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788940320.204480:0:7642:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788940320.204489:0:7642:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788940320.204509:0:7642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f181520400/0x27a633fcdd4a9ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940320.204586:0:7648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940320.204591:0:7648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff89f082ad3800/0x27a633fcdd4a99e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x400000000 nid: local remote: 0x27a633fcdd4a9a5 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940320.204597:0:7648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad3800 already unused, calling callback (ffffffffc1d10c20) 10000000:00010000:1.0:1788940320.204600:0:7648:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff89f082ad3800/0x27a633fcdd4a99e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x400000000 nid: local remote: 0x27a633fcdd4a9a5 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940320.204606:0:7648:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff89f082ad3800/0x27a633fcdd4a99e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x8400000000 nid: local remote: 0x27a633fcdd4a9a5 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788940320.204611:0:7648:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff89f082ad3800/0x27a633fcdd4a99e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x9400000000 nid: local remote: 0x27a633fcdd4a9a5 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940320.204614:0:7648:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788940320.204629:0:7648:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff89f082ad3800/0x27a633fcdd4a99e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x4809400000020 nid: local remote: 0x27a633fcdd4a9a5 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940320.204633:0:7648:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788940320.204669:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4cd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3308:1875839738199680:0@lo:103: 00000100:00100000:0.0:1788940320.204696:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940320.204743:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738199680 00010000:00010000:1.0:1788940320.204746:0:7648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff89f082ad3800/0x27a633fcdd4a99e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x4809400000020 nid: local remote: 0x27a633fcdd4a9a5 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940320.204748:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738199680 00010000:00010000:1.0:1788940320.204753:0:7648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff89f082ad3800/0x27a633fcdd4a99e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x4809400000020 nid: local remote: 0x27a633fcdd4a9a5 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940320.204766:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940320.204768:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940320.204770:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940320.204780:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788940320.204788:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f198182300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+12:3308:x1875839738199680:12345-0@lo:103: 00010000:00010000:3.0:1788940320.204797:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940320.204809:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f1c21f0e00/0x27a633fcdd4a9a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x27a633fcdd4a99e expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940320.204817:0:7642:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f181520400/0x27a633fcdd4a9ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940320.204822:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788940320.204828:0:7642:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f181520400/0x27a633fcdd4a9ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940320.204840:0:7642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:7642:1875839738199552:0@lo:101: 00000100:00100000:2.0:1788940320.205281:0:7642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940320.205302:0:7642:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1a973e900 going to sleep for 11 seconds 00000100:00100000:3.0:1788940320.205402:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f198182300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+11:3308:x1875839738199680:12345-0@lo:103: Request processed in 614us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940320.205411:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788940320.205422:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4cd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3308:1875839738199680:0@lo:103: 00000100:00100000:1.0:1788940320.205603:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738199552 00000100:00100000:1.0:1788940320.205607:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738199552 00000100:00100000:1.0:1788940320.205637:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788940320.205644:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1980dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+11:7642:x1875839738199552:12345-0@lo:101: 00010000:00010000:1.0:1788940320.205665:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940320.205680:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f1c21f1e00/0x27a633fcdd4a9b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4a9ac expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940320.205701:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f1c21f1e00/0x27a633fcdd4a9b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4a9ac expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940320.205711:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f1c21f1e00/0x27a633fcdd4a9b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4a9ac expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940320.205716:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f1c21f1e00, rc 0) 00000100:00100000:1.0:1788940320.205752:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1980dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+12:7642:x1875839738199552:12345-0@lo:101: Request processed in 109us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940320.205756:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788940320.205845:0:7642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:7642:1875839738199552:0@lo:101: 00010000:00010000:2.0:1788940320.205855:0:7642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f181520400/0x27a633fcdd4a9ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4a9b3 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940320.205861:0:7642:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f181520400/0x27a633fcdd4a9ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4a9b3 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940320.205927:0:7642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:7642:1875839738199808:0@lo:501: 00000100:00100000:2.0:1788940320.205945:0:7642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940320.205994:0:7642:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1a973e900 going to sleep for 11 seconds 00000100:00100000:0.0:1788940320.206110:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738199808 00000100:00100000:0.0:1788940320.206115:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738199808 00000100:00100000:0.0:1788940320.206148:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788940320.206154:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1980dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+12:7642:x1875839738199808:12345-0@lo:501: 00000100:00100000:0.0:1788940320.206491:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1980dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+12:7642:x1875839738199808:12345-0@lo:501: Request processed in 336us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940320.206498:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788940320.206568:0:7642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:7642:1875839738199808:0@lo:501: 00000100:00100000:2.0:1788940320.206598:0:7642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:7642:1875839738199936:0@lo:503: 00000100:00100000:2.0:1788940320.206636:0:7642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940320.206659:0:7642:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1a973e900 going to sleep for 11 seconds 00000100:00100000:0.0:1788940320.206702:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738199936 00000100:00100000:0.0:1788940320.206706:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738199936 00000100:00100000:0.0:1788940320.206760:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788940320.206767:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1980dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+12:7642:x1875839738199936:12345-0@lo:503: 00000100:00100000:0.0:1788940320.206915:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1980dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+12:7642:x1875839738199936:12345-0@lo:503: Request processed in 148us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940320.206922:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788940320.206992:0:7642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:7642:1875839738199936:0@lo:503: 00000040:00080000:2.0:1788940320.207242:0:7642:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788940320.207298:0:7642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:7642:1875839738200064:0@lo:502: 00000100:00100000:2.0:1788940320.207326:0:7642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940320.207415:0:7642:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1a973e900 going to sleep for 11 seconds 00000100:00100000:1.0:1788940320.207490:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738200064 00000100:00100000:1.0:1788940320.207495:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738200064 00000100:00100000:1.0:1788940320.207609:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788940320.207618:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1980df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+12:7642:x1875839738200064:12345-0@lo:502: 00000100:00100000:1.0:1788940320.207737:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1980df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+12:7642:x1875839738200064:12345-0@lo:502: Request processed in 121us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940320.207742:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788940320.207802:0:7642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:7642:1875839738200064:0@lo:502: 00000040:00080000:2.0:1788940320.207959:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788940320.207989:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1788940320.208005:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1788940320.208064:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1788940320.208104:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1788940320.208130:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1788940320.208146:0:7642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:7642:1875839738200192:0@lo:502: 00000100:00100000:2.0:1788940320.208171:0:7642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940320.209055:0:7642:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1a973e900 going to sleep for 11 seconds 00000100:00100000:3.0:1788940320.209141:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738200192 00000100:00100000:3.0:1788940320.209149:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738200192 00000100:00100000:3.0:1788940320.209188:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788940320.209199:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1980df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+12:7642:x1875839738200192:12345-0@lo:502: 00000100:00100000:3.0:1788940320.209624:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1980df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+12:7642:x1875839738200192:12345-0@lo:502: Request processed in 425us (1450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940320.209633:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788940320.209799:0:7642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:7642:1875839738200192:0@lo:502: 00000040:00080000:2.0:1788940320.209920:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788940320.209931:0:7642:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1788940320.210515:0:7653:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788940320.210579:0:7653:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1788940320.210585:0:7653:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940320.210586:0:7653:0:(obd_config.c:1662:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788940320.210591:0:7653:0:(obd_config.c:1571:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788940320.210601:0:7653:0:(genops.c:415:class_newdev()) Allocate new device lustre-OST0001 (ffff89f198018000) 00000020:00000080:2.0:1788940320.210618:0:7653:0:(obd_config.c:786:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788940320.210621:0:7653:0:(obd_config.c:1571:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788940320.210676:0:7653:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89f1bf721000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788940320.210681:0:7653:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788940320.210685:0:7653:0:(genops.c:1393:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x27a633fcdd4a9c1 00010000:00010000:2.0:1788940320.213621:0:7653:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:2.0:1788940320.213895:0:7653:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1788940320.216011:0:7653:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788940320.216276:0:7653:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1788940320.219993:0:7653:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1788940320.220886:0:7653:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1788940320.222054:0:7653:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788940320.222065:0:7653:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788940320.222072:0:7653:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940320.222074:0:7653:0:(obd_config.c:1662:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788940320.222078:0:7653:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788940320.222081:0:7653:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940320.222083:0:7653:0:(obd_config.c:1662:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788940320.222086:0:7653:0:(obd_config.c:1571:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788940320.222087:0:7653:0:(obd_config.c:1636:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788940320.222144:0:7653:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788940320.222147:0:7653:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940320.222148:0:7653:0:(obd_config.c:1662:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788940320.222150:0:7653:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788940320.222274:0:7642:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1788940320.222294:0:7642:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788940320.222313:0:7642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f181520400/0x27a633fcdd4a9ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4a9b3 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940320.222324:0:7642:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f181520400/0x27a633fcdd4a9ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4a9b3 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940320.222447:0:7642:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89f1bf721000 from 1 10000000:01000000:1.0:1788940320.222450:0:7642:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788940320.222486:0:7642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f1c21f0200/0x27a633fcdd4a9c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940320.222493:0:7642:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f1c21f0200/0x27a633fcdd4a9c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940320.222504:0:7642:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f1c21f0200/0x27a633fcdd4a9c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940320.222560:0:7642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4cd1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:7642:1875839738200320:0@lo:101: 00000100:00100000:1.0:1788940320.222617:0:7642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940320.222648:0:7642:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f18403d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788940320.222667:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738200320 00000100:00100000:1.0:1788940320.222674:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738200320 00000100:00100000:1.0:1788940320.222710:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788940320.222716:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1980dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+12:7642:x1875839738200320:12345-0@lo:101: 00010000:00010000:1.0:1788940320.222729:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940320.222738:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f1c21f0a00/0x27a633fcdd4a9cf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4a9c8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940320.222757:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f1c21f0a00/0x27a633fcdd4a9cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4a9c8 expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940320.222764:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f1c21f0a00/0x27a633fcdd4a9cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4a9c8 expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940320.222771:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f1c21f0a00, rc 0) 00000100:00100000:1.0:1788940320.222805:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1980dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+13:7642:x1875839738200320:12345-0@lo:101: Request processed in 90us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940320.222810:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788940320.222849:0:7642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4cd1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:7642:1875839738200320:0@lo:101: 00010000:00010000:1.0:1788940320.222859:0:7642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f1c21f0200/0x27a633fcdd4a9c8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4a9cf expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940320.222865:0:7642:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f1c21f0200/0x27a633fcdd4a9c8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4a9cf expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940320.222924:0:7642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4cd1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:7642:1875839738200448:0@lo:501: 00000100:00100000:1.0:1788940320.222947:0:7642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940320.222961:0:7642:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f18403d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940320.225583:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738200448 00000100:00100000:2.0:1788940320.225593:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738200448 00000100:00100000:2.0:1788940320.225632:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788940320.225640:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1980dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+13:7642:x1875839738200448:12345-0@lo:501: 00000100:00100000:2.0:1788940320.225863:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1980dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+13:7642:x1875839738200448:12345-0@lo:501: Request processed in 223us (2915us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940320.225868:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788940320.228547:0:7642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4cd1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:7642:1875839738200448:0@lo:501: 00000100:00100000:0.0:1788940320.228603:0:7642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198181500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:7642:1875839738200576:0@lo:503: 00000100:00100000:0.0:1788940320.228672:0:7642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940320.228710:0:7642:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1b0c92cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788940320.228761:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738200576 00000100:00100000:3.0:1788940320.228766:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738200576 00000100:00100000:3.0:1788940320.228812:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788940320.228820:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1980de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+13:7642:x1875839738200576:12345-0@lo:503: 00000100:00100000:3.0:1788940320.229177:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1980de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+13:7642:x1875839738200576:12345-0@lo:503: Request processed in 356us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940320.229185:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788940320.230490:0:7642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198181500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:7642:1875839738200576:0@lo:503: 00000040:00080000:0.0:1788940320.230813:0:7642:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788940320.230884:0:7642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198181500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:7642:1875839738200704:0@lo:502: 00000100:00100000:0.0:1788940320.230949:0:7642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940320.230987:0:7642:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1b0c92cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788940320.231542:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738200704 00000100:00100000:3.0:1788940320.231550:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738200704 00000100:00100000:3.0:1788940320.231593:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788940320.231602:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1980df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+13:7642:x1875839738200704:12345-0@lo:502: 00000100:00100000:3.0:1788940320.231815:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1980df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+13:7642:x1875839738200704:12345-0@lo:502: Request processed in 212us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940320.231823:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788940320.231881:0:7642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198181500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:7642:1875839738200704:0@lo:502: 00000040:00080000:3.0:1788940320.233751:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788940320.233828:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788940320.233869:0:7642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b48a5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:7642:1875839738200832:0@lo:502: 00000100:00100000:3.0:1788940320.233927:0:7642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940320.233962:0:7642:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f195ed3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788940320.234054:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738200832 00000100:00100000:0.0:1788940320.234062:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738200832 00000100:00100000:0.0:1788940320.234104:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788940320.234111:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1980dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+13:7642:x1875839738200832:12345-0@lo:502: 00000100:00100000:0.0:1788940320.234243:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1980dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+13:7642:x1875839738200832:12345-0@lo:502: Request processed in 132us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940320.234249:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788940320.238122:0:7642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b48a5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:7642:1875839738200832:0@lo:502: 00000040:00080000:3.0:1788940320.238319:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788940320.238336:0:7642:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788940320.242316:0:7657:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788940320.242449:0:7657:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940320.242452:0:7657:0:(obd_config.c:1662:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788940320.242460:0:7657:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: general-ffff89f1bf721000 00000020:00000080:0.0:1788940320.242491:0:7657:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788940320.242533:0:7657:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788940320.242538:0:7657:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940320.242539:0:7657:0:(obd_config.c:1662:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788940320.242543:0:7657:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1788940320.243068:0:7642:0:(obd_config.c:2244:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788940320.243095:0:7642:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788940320.243114:0:7642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f1c21f0200/0x27a633fcdd4a9c8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4a9cf expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940320.243128:0:7642:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f1c21f0200/0x27a633fcdd4a9c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4a9cf expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940320.243169:0:7642:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788940320.243171:0:7642:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff89f1bf721000 10000000:01000000:3.0:1788940320.243174:0:7642:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff89f1bf721000 10000000:01000000:3.0:1788940320.243177:0:7642:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788940320.243181:0:7642:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff89f1bf721000 from 1 10000000:01000000:3.0:1788940320.243183:0:7642:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788940320.243219:0:7642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f1829db400/0x27a633fcdd4a9d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940320.243225:0:7642:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f1829db400/0x27a633fcdd4a9d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940320.243235:0:7642:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f1829db400/0x27a633fcdd4a9d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940320.243254:0:7642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b48a5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:7642:1875839738200960:0@lo:101: 00000100:00100000:3.0:1788940320.243312:0:7642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940320.243361:0:7642:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f195ed3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788940320.243562:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738200960 00000100:00100000:0.0:1788940320.243571:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738200960 00000100:00100000:0.0:1788940320.243627:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788940320.243638:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18415cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+13:7642:x1875839738200960:12345-0@lo:101: 00010000:00010000:0.0:1788940320.243654:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940320.243669:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f082ad2000/0x27a633fcdd4a9dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4a9d6 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940320.243693:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f082ad2000/0x27a633fcdd4a9dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4a9d6 expref: 14 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940320.243704:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f082ad2000/0x27a633fcdd4a9dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4a9d6 expref: 14 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940320.243712:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f082ad2000, rc 0) 00000100:00100000:0.0:1788940320.243763:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18415cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+14:7642:x1875839738200960:12345-0@lo:101: Request processed in 127us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940320.243769:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788940320.244084:0:7642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b48a5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:7642:1875839738200960:0@lo:101: 00010000:00010000:3.0:1788940320.244098:0:7642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f1829db400/0x27a633fcdd4a9d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4a9dd expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940320.244120:0:7642:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f1829db400/0x27a633fcdd4a9d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4a9dd expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940320.244222:0:7642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b48a5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:7642:1875839738201088:0@lo:501: 00000100:00100000:3.0:1788940320.244252:0:7642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940320.244287:0:7642:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f195ed3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788940320.244333:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738201088 00000100:00100000:0.0:1788940320.244338:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738201088 00000100:00100000:0.0:1788940320.244467:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788940320.244475:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18415d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+14:7642:x1875839738201088:12345-0@lo:501: 00000100:00100000:0.0:1788940320.244690:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18415d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+14:7642:x1875839738201088:12345-0@lo:501: Request processed in 215us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940320.244695:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788940320.244752:0:7642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b48a5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:7642:1875839738201088:0@lo:501: 00000100:00100000:3.0:1788940320.244771:0:7642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b48a5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:7642:1875839738201216:0@lo:503: 00000100:00100000:3.0:1788940320.244799:0:7642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940320.245081:0:7642:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f195ed3b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788940320.245109:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738201216 00000100:00100000:1.0:1788940320.245217:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738201216 00000100:00100000:1.0:1788940320.245239:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788940320.245245:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18415f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+14:7642:x1875839738201216:12345-0@lo:503: 00000100:00100000:1.0:1788940320.247878:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18415f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+14:7642:x1875839738201216:12345-0@lo:503: Request processed in 2622us (3067us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940320.247891:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788940320.248017:0:7642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b48a5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:7642:1875839738201216:0@lo:503: 00000040:00080000:3.0:1788940320.251083:0:7642:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788940320.251193:0:7642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b48a5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:7642:1875839738201344:0@lo:502: 00000100:00100000:3.0:1788940320.251263:0:7642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940320.251302:0:7642:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f195ed3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788940320.251306:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738201344 00000100:00100000:0.0:1788940320.251314:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738201344 00000100:00100000:0.0:1788940320.251451:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788940320.251462:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18415f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+14:7642:x1875839738201344:12345-0@lo:502: 00000100:00100000:0.0:1788940320.251919:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18415f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+14:7642:x1875839738201344:12345-0@lo:502: Request processed in 456us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940320.251928:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788940320.251965:0:7642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b48a5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:7642:1875839738201344:0@lo:502: 00000040:00080000:3.0:1788940320.252264:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788940320.252299:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788940320.252316:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788940320.252429:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788940320.252463:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788940320.252501:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788940320.252628:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788940320.252650:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788940320.252676:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788940320.252694:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788940320.252722:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788940320.252748:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788940320.252768:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788940320.252785:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788940320.252827:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788940320.252849:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788940320.252875:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788940320.252901:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788940320.252919:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788940320.252935:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788940320.252959:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788940320.252977:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788940320.252994:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788940320.253041:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788940320.253066:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1788940320.253083:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1788940320.253107:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1788940320.253247:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:3.0:1788940320.253266:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1788940320.253292:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:3.0:1788940320.253309:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:3.0:1788940320.253335:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:3.0:1788940320.253449:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:3.0:1788940320.253491:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:3.0:1788940320.253685:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:3.0:1788940320.253731:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:3.0:1788940320.253751:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:3.0:1788940320.253789:0:7642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b48a5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:7642:1875839738201472:0@lo:502: 00000100:00100000:3.0:1788940320.253848:0:7642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940320.253911:0:7642:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f195ed3b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788940320.253947:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738201472 00000100:00100000:1.0:1788940320.253953:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738201472 00000100:00100000:1.0:1788940320.254017:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788940320.254035:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18415d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+14:7642:x1875839738201472:12345-0@lo:502: 00000100:00100000:1.0:1788940320.254506:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18415d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+14:7642:x1875839738201472:12345-0@lo:502: Request processed in 472us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940320.254514:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788940320.254603:0:7642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b48a5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:7642:1875839738201472:0@lo:502: 00000040:00080000:3.0:1788940320.254670:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1788940320.254678:0:7642:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1788940320.255186:0:7658:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788940320.255198:0:7658:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff89f1bf86b3b0) 00000020:00000080:3.0:1788940320.255215:0:7658:0:(obd_config.c:786:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1788940320.255265:0:7658:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89f1bf721000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788940320.255268:0:7658:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89f1bf721000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788940320.255270:0:7658:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89f1bf721000 3 00010000:00080000:3.0:1788940320.255293:0:7658:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89f1b5042000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.114@tcp at head 00010000:00010000:3.0:1788940320.256859:0:7658:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1788940320.257054:0:7658:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788940320.257086:0:7658:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788940320.257099:0:7658:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x27a633fcdd4a9eb 00000100:00080000:3.0:1788940320.257113:0:7658:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788940320.257119:0:7658:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89f1b5042000 using connection 192.168.202.114@tcp/0@lo 00000100:00100000:3.0:1788940320.257159:0:7658:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89f1b48a5f80 x1875839738201600/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788940320.257188:0:7658:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788940320.258191:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b48a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1875839738201600:0@lo:38: 00000100:00100000:2.0:1788940320.258266:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940320.258351:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738201600 00000100:00100000:1.0:1788940320.258360:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738201600 00000100:00100000:1.0:1788940320.258399:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788940320.258409:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3304:x1875839738201600:12345-0@lo:38: 00010000:00080000:1.0:1788940320.258436:0:5861:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 263 last 0 00000020:00000080:1.0:1788940320.258469:0:5861:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x27a633fcdd4a9f2 00000004:00100000:1.0:1788940320.258483:0:5861:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788940320.258514:0:5861:0:(import.c:65:import_set_state_nolock()) ffff89f19016b000 : changing import state from RECOVER to FULL 00000040:00080000:2.0:1788940320.258581:0:7658:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:1.0:1788940320.258584:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875839738201600:12345-0@lo:38: Request processed in 175us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940320.258590:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788940320.258632:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89f1b48a5f80 x1875839738201600/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788940330 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940320.258641:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788940320.258650:0:3304:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1788940320.258656:0:3304:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788940320.258660:0:3304:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788940320.258662:0:3304:0:(import.c:65:import_set_state_nolock()) ffff89f1b5042000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788940320.258668:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b48a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1875839738201600:0@lo:38: 00000100:00100000:2.0:1788940320.258707:0:7659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6e680 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7659:1875839738201728:0@lo:901: 00000100:00100000:2.0:1788940320.258736:0:7659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940320.258767:0:7659:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1a973e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788940320.258817:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198183480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875839738201856:0@lo:400: 00000100:00100000:0.0:1788940320.258845:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940320.258863:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788940320.258868:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198181880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875839738201984:0@lo:400: 00000100:00100000:0.0:1788940320.258888:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940320.258909:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788940320.258916:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198180700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738202112:0@lo:400: 00000100:00100000:0.0:1788940320.258944:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940320.258965:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738202112 00000100:00100000:2.0:1788940320.258969:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738202112 00000020:01000000:0.0:1788940320.258971:0:7642:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1788940320.258993:0:7642:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-client' succeeded (0). 00000100:00100000:2.0:1788940320.259006:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788940320.259007:0:7642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f1829db400/0x27a633fcdd4a9d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4a9dd expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940320.259013:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f198181500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738202112:12345-0@lo:400: 00010000:00010000:0.0:1788940320.259018:0:7642:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f1829db400/0x27a633fcdd4a9d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4a9dd expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940320.259064:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f198181500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738202112:12345-0@lo:400: Request processed in 51us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940320.259070:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000004:0.0:1788940320.259088:0:7642:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788940320.259090:0:7642:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788940320.259092:0:7642:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788940320.259093:0:7642:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788940320.259094:0:7642:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788940320.259096:0:7642:0:(tgt_mount.c:1180:server_mti_print()) flags: 00010000:00080000:2.0:1788940320.259098:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89f198180700 x1875839738202112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940336 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000020:01000004:0.0:1788940320.259098:0:7642:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788940320.259103:0:7642:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788940320.259104:0:7642:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788940320.259106:0:7642:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788940320.259107:0:7642:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1788940320.259108:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198180700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738202112:0@lo:400: 10000000:01000000:0.0:1788940320.259111:0:7642:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1788940320.259113:0:7642:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788940320.259114:0:7642:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788940320.259115:0:7642:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788940320.259116:0:7642:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788940320.259117:0:7642:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788940320.259118:0:7642:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788940320.259119:0:7642:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788940320.259119:0:7642:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788940320.259120:0:7642:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788940320.259121:0:7642:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788940320.259122:0:7642:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788940320.259148:0:7642:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788940320.259157:0:7642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:7642:1875839738202240:0@lo:253: 00000100:00100000:0.0:1788940320.259191:0:7642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940320.259215:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738202240 00000100:00100000:0.0:1788940320.259218:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738202240 00000100:00100000:0.0:1788940320.259247:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788940320.259253:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18415c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+14:7642:x1875839738202240:12345-0@lo:253: 20000000:01000000:0.0:1788940320.259271:0:5853:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788940320.259284:0:5853:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788940320.259719:0:7642:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1ae807a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788940320.260095:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738201728 00000100:00100000:1.0:1788940320.260102:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738201728 00000100:00100000:1.0:1788940320.260175:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788940320.260183:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7659:x1875839738201728:12345-0@lo:901: 00000100:00100000:1.0:1788940320.260545:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7659:x1875839738201728:12345-0@lo:901: Request processed in 362us (1807us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940320.260552:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788940320.260826:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738201856 00000100:00100000:1.0:1788940320.260831:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738201856 00000100:00100000:1.0:1788940320.260897:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738201984 00000100:00100000:1.0:1788940320.260901:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738201984 00000100:00100000:0.0:1788940320.260941:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788940320.260949:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f198182a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875839738201856:12345-0@lo:400: 00000100:00100000:0.0:1788940320.260993:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f198182a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875839738201856:12345-0@lo:400: Request processed in 45us (2147us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940320.260999:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788940320.261013:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788940320.261019:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f198180000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875839738201984:12345-0@lo:400: 00000100:00100000:0.0:1788940320.261068:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f198180000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875839738201984:12345-0@lo:400: Request processed in 48us (2178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940320.261074:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1788940320.261112:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89f198181880 x1875839738201984/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940336 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940320.261127:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198181880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875839738201984:0@lo:400: 00010000:00080000:0.0:1788940320.261140:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89f198183480 x1875839738201856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940336 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940320.261148:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198183480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875839738201856:0@lo:400: 00000100:00080000:1.0:1788940320.261284:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788940320.261289:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788940320.261375:0:7659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89f1b5c6e680 x1875839738201728/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788940336 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940320.261385:0:7659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6e680 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7659:1875839738201728:0@lo:901: 20000000:01000000:2.0:1788940320.278471:0:5853:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788940320.278490:0:5853:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1788940320.278846:0:5876:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788940320.278852:0:5876:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788940320.278877:0:5876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89f1c21f0600/0x27a633fcdd4a9f9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940320.278895:0:5876:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89f180031a00/0x27a633fcdd4a94a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4a943 expref: 14 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940320.278901:0:5876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89f1c21f0600/0x27a633fcdd4a9f9 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940320.278936:0:5876:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89f180031a00/0x27a633fcdd4a94a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27a633fcdd4a943 expref: 14 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940320.278947:0:5876:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89f180031a00/0x27a633fcdd4a94a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27a633fcdd4a943 expref: 14 pid: 5853 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940320.278958:0:5876:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4cd0000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5876:1875839738202368:0@lo:104: 00000100:00100000:1.0:1788940320.279016:0:5876:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940320.279110:0:5876:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f187c03a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788940320.279202:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738202368 00000100:00100000:3.0:1788940320.279210:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738202368 00000100:00100000:3.0:1788940320.279551:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788940320.279605:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+3:5876:x1875839738202368:12345-0@lo:104: 00010000:00010000:3.0:1788940320.279619:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff89f180031e00/0x27a633fcdd4a943 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4a94a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940320.279678:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788940320.279683:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+3:5876:x1875839738202368:12345-0@lo:104: Request processed in 83us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940320.279702:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788940320.279891:0:5876:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4cd0000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5876:1875839738202368:0@lo:104: 00010000:00010000:1.0:1788940320.279908:0:5876:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89f1c21f0600/0x27a633fcdd4a9f9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940320.280015:0:5848:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940320.280029:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff89f180031e00/0x27a633fcdd4a943 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4a94a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940320.280035:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f180031e00 already unused, calling callback (ffffffffc1d10c20) 10000000:00010000:0.0:1788940320.280038:0:5848:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff89f180031e00/0x27a633fcdd4a943 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x27a633fcdd4a94a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940320.280044:0:5848:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff89f180031e00/0x27a633fcdd4a943 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x27a633fcdd4a94a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788940320.280049:0:5848:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff89f180031e00/0x27a633fcdd4a943 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x27a633fcdd4a94a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940320.280053:0:5848:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788940320.280086:0:5848:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff89f180031e00/0x27a633fcdd4a943 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4a94a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940320.280092:0:5848:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788940320.280119:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff89f180031e00/0x27a633fcdd4a943 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4a94a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940320.280127:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff89f180031e00/0x27a633fcdd4a943 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4a94a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940320.280134:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3308:1875839738202496:0@lo:103: 00010000:00010000:0.0:1788940320.280143:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940320.280145:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940320.280146:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940320.280170:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940320.280249:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738202496 00000100:00100000:0.0:1788940320.280253:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738202496 00010000:00010000:0.0:1788940320.280268:0:5845:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89f180031a00/0x27a633fcdd4a94a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4a943 expref: 15 pid: 5853 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940320.280290:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788940320.280294:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1841b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+15:3308:x1875839738202496:12345-0@lo:103: 00010000:00010000:0.0:1788940320.280301:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940320.280305:0:5845:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89f180031a00/0x27a633fcdd4a94a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4a943 expref: 15 pid: 5853 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940320.280315:0:5845:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89f180031a00/0x27a633fcdd4a94a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27a633fcdd4a943 expref: 15 pid: 5853 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940320.280328:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f180031a00/0x27a633fcdd4a94a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27a633fcdd4a943 expref: 15 pid: 5853 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940320.280340:0:5845:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89f1c21f0600/0x27a633fcdd4a9f9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940320.280348:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f1c21f0600/0x27a633fcdd4a9f9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788940320.280371:0:5845:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003308607s 00010000:00010000:0.0:1788940320.280376:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89f1c21f0600/0x27a633fcdd4a9f9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940320.280384:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89f1c21f0600/0x27a633fcdd4a9f9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940320.280391:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89f1c21f0600/0x27a633fcdd4a9f9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940320.280397:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89f1c21f0600/0x27a633fcdd4a9f9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940320.280402:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1c21f0600 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:0.0:1788940320.280406:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89f1c21f0600/0x27a633fcdd4a9f9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940320.280413:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89f1c21f0600/0x27a633fcdd4a9f9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940320.280437:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89f1c21f0600/0x27a633fcdd4a9f9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940320.280446:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940320.280493:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1841b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+14:3308:x1875839738202496:12345-0@lo:103: Request processed in 197us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940320.280500:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788940320.280575:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3308:1875839738202496:0@lo:103: 00010000:00010000:2.0:1788940320.280726:0:5876:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89f1c21f0600/0x27a633fcdd4a9f9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940320.280732:0:5876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89f1c21f0600/0x27a633fcdd4a9f9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940320.280736:0:5876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f1c21f0600/0x27a633fcdd4a9f9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940320.284995:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18415c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+13:7642:x1875839738202240:12345-0@lo:253: Request processed in 25734us (25796us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940320.285008:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788940320.285079:0:7642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1220f165-b68f-42ea-b6cd-5f8ad1a18830:7642:1875839738202240:0@lo:253: 10000000:01000000:0.0:1788940320.285109:0:7642:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788940320.285111:0:7642:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788940320.285113:0:7642:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788940320.285114:0:7642:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788940320.285115:0:7642:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788940320.285115:0:7642:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788940320.285116:0:7642:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788940320.285117:0:7642:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788940320.285118:0:7642:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788940320.285119:0:7642:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788940320.285120:0:7642:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788940320.285121:0:7642:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788940320.285133:0:7642:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788940320.289769:0:7642:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788940320.289953:0:7642:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788940320.290185:0:7642:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788940320.290785:0:7642:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788940320.291006:0:7642:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788940320.291251:0:7642:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788940320.294766:0:7642:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:1.0:1788940320.428612:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788940320.430721:0:7642:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788940320.430728:0:7642:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788940320.430763:0:7642:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788940320.430817:0:7642:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.114@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788940320.430839:0:7642:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788940320.430869:0:7642:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1788940321.452885:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940322.476760:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940323.319748:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788940323.319782:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b48a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738202624:0@lo:13: 00000100:00100000:3.0:1788940323.319865:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940323.319940:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738202624 00000100:00100000:3.0:1788940323.319949:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738202624 00000100:00100000:3.0:1788940323.320230:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788940323.320244:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b48a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738202624:12345-0@lo:13: 00002000:00000024:3.0:1788940323.320289:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788940323.320343:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b48a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738202624:12345-0@lo:13: Request processed in 101us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940323.320351:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1788940323.320378:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788940323.320407:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1b48a7480 x1875839738202624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940339 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940323.320438:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b48a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738202624:0@lo:13: 00010000:00010000:1.0:1788940323.505061:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940324.525631:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940325.360281:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b48a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738203136:0@lo:400: 00000100:00100000:3.0:1788940325.360354:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940325.360410:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788940325.360416:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b48a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3305:1875839738202752:0@lo:400: 00000100:00100000:3.0:1788940325.360443:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940325.360463:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b48a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875839738203264:0@lo:400: 00000100:00100000:3.0:1788940325.360488:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940325.360536:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738202752 00000100:00100000:1.0:1788940325.360546:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738202752 00000100:00100000:1.0:1788940325.365296:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788940325.365323:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18415e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+13:3305:x1875839738202752:12345-0@lo:400: 00000100:00100000:1.0:1788940325.365424:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18415e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+13:3305:x1875839738202752:12345-0@lo:400: Request processed in 114us (4979us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940325.365444:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788940325.376296:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b48a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3305:1875839738202752:0@lo:400: 00000100:00100000:3.0:1788940325.376341:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b48a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875839738202880:0@lo:400: 00000100:00100000:3.0:1788940325.376397:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940325.376441:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788940325.376448:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b48a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875839738203008:0@lo:400: 00000100:00100000:3.0:1788940325.376469:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940325.376530:0:7074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738203136 00000100:00100000:3.0:1788940325.376546:0:7074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738203136 00000100:00100000:3.0:1788940325.376608:0:7074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788940325.376619:0:7074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b48a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738203136:12345-0@lo:400: 00000100:00100000:3.0:1788940325.376682:0:7074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b48a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738203136:12345-0@lo:400: Request processed in 65us (16327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940325.376689:0:7074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788940325.376722:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738203264 00000100:00100000:3.0:1788940325.376726:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738203264 00010000:00080000:1.0:1788940325.376735:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1b48a7b80 x1875839738203136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940341 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940325.376749:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738202880 00000100:00100000:1.0:1788940325.376751:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b48a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738203136:0@lo:400: 00000100:00100000:3.0:1788940325.376754:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738202880 00000100:00100000:3.0:1788940325.376773:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738203008 00000100:00100000:3.0:1788940325.376776:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738203008 00000100:00100000:3.0:1788940325.376791:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788940325.376797:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b48a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875839738203264:12345-0@lo:400: 00000100:00100000:3.0:1788940325.376845:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b48a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875839738203264:12345-0@lo:400: Request processed in 48us (16356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940325.376850:0:5862:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788940325.376851:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788940325.376860:0:5862:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788940325.376868:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788940325.376876:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b48a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875839738202880:12345-0@lo:400: 00010000:00080000:1.0:1788940325.376879:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1b48a5c00 x1875839738203264/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940341 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940325.376891:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b48a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875839738203264:0@lo:400: 00000100:00100000:3.0:1788940325.376919:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b48a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875839738202880:12345-0@lo:400: Request processed in 45us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940325.376939:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788940325.376952:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788940325.376958:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b48a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875839738203008:12345-0@lo:400: 00000100:00100000:3.0:1788940325.376999:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b48a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875839738203008:12345-0@lo:400: Request processed in 41us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940325.377005:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1788940325.377032:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788940325.377036:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788940325.377064:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1b48a6d80 x1875839738203008/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940341 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940325.377075:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b48a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875839738203008:0@lo:400: 00010000:00080000:0.0:1788940325.377086:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1b48a7800 x1875839738202880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940341 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940325.377094:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b48a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875839738202880:0@lo:400: 00010000:00010000:1.0:1788940325.549877:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940326.576578:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940327.601202:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788940328.410129:0:8002:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg214-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1788940328.440750:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738203392:0@lo:13: 00000100:00100000:3.0:1788940328.440827:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940328.440932:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738203392 00000100:00100000:2.0:1788940328.440941:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738203392 00000100:00100000:2.0:1788940328.441024:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788940328.441035:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b48a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738203392:12345-0@lo:13: 00002000:00000024:2.0:1788940328.441074:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788940328.441126:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b48a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738203392:12345-0@lo:13: Request processed in 93us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940328.441133:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1788940328.441188:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788940328.441236:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1b5c6d180 x1875839738203392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940344 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940328.441257:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738203392:0@lo:13: 00010000:00010000:2.0:1788940328.633687:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788940329.455133:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788940329.455139:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff89f19016d800 from 30 10000000:01000000:0.0:1788940329.455143:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788940329.455193:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f082ad3400/0x27a633fcdd4aa00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940329.455204:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f082ad3400/0x27a633fcdd4aa00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940329.455217:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f082ad3400/0x27a633fcdd4aa00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940329.455240:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738203520:0@lo:101: 00000100:00100000:0.0:1788940329.455322:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940329.455371:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1aeec60c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940329.456588:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738203520 00000100:00100000:2.0:1788940329.456604:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738203520 00000100:00100000:2.0:1788940329.456667:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788940329.456678:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18415f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+13:5858:x1875839738203520:12345-0@lo:101: 00010000:00010000:2.0:1788940329.456695:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940329.456711:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f181520000/0x27a633fcdd4aa07 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4aa00 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940329.456741:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f181520000/0x27a633fcdd4aa07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4aa00 expref: 14 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940329.456751:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f181520000/0x27a633fcdd4aa07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4aa00 expref: 14 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940329.456759:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f181520000, rc 0) 00000100:00100000:2.0:1788940329.456823:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18415f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+14:5858:x1875839738203520:12345-0@lo:101: Request processed in 146us (1500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940329.456841:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788940329.456953:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738203520:0@lo:101: 00010000:00010000:0.0:1788940329.456972:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f082ad3400/0x27a633fcdd4aa00 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4aa07 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940329.456982:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f082ad3400/0x27a633fcdd4aa00 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4aa07 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940329.457055:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738203648:0@lo:501: 00000100:00100000:0.0:1788940329.457086:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940329.457124:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1aeec60c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940329.457164:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738203648 00000100:00100000:2.0:1788940329.457168:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738203648 00000100:00100000:2.0:1788940329.457205:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788940329.457212:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18415ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+14:5858:x1875839738203648:12345-0@lo:501: 00000100:00100000:2.0:1788940329.457742:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18415ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+14:5858:x1875839738203648:12345-0@lo:501: Request processed in 528us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940329.457749:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788940329.458044:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738203648:0@lo:501: 00000100:00100000:0.0:1788940329.458078:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738203776:0@lo:503: 00000100:00100000:0.0:1788940329.458120:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940329.458149:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1aeec60c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788940329.458229:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738203776 00000100:00100000:1.0:1788940329.458234:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738203776 00000100:00100000:1.0:1788940329.458507:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788940329.458534:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18415dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+14:5858:x1875839738203776:12345-0@lo:503: 00000100:00100000:1.0:1788940329.458750:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18415dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+14:5858:x1875839738203776:12345-0@lo:503: Request processed in 235us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940329.458757:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788940329.458852:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738203776:0@lo:503: 00000100:00100000:0.0:1788940329.471988:0:8060:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:8060:1875839738203904:0@lo:502: 00000100:00100000:0.0:1788940329.472086:0:8060:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940329.472137:0:8060:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1aeec6600 going to sleep for 11 seconds 00000100:00100000:1.0:1788940329.472205:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738203904 00000100:00100000:1.0:1788940329.472214:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738203904 00000100:00100000:1.0:1788940329.472618:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788940329.472631:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18415c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+14:8060:x1875839738203904:12345-0@lo:502: 00000100:00100000:1.0:1788940329.473037:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18415c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+14:8060:x1875839738203904:12345-0@lo:502: Request processed in 407us (950us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940329.473044:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788940329.475333:0:8060:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:8060:1875839738203904:0@lo:502: 00000100:00100000:2.0:1788940329.475618:0:8060:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:8060:1875839738204032:0@lo:502: 00000100:00100000:2.0:1788940329.475684:0:8060:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940329.475724:0:8060:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f187c03a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788940329.475794:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738204032 00000100:00100000:0.0:1788940329.475802:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738204032 00000100:00100000:0.0:1788940329.475855:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788940329.475865:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18415e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+14:8060:x1875839738204032:12345-0@lo:502: 00000100:00100000:0.0:1788940329.476096:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18415e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+14:8060:x1875839738204032:12345-0@lo:502: Request processed in 232us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940329.476105:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788940329.476212:0:8060:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:8060:1875839738204032:0@lo:502: 00000040:00080000:2.0:1788940329.476235:0:8060:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788940329.481074:0:5858:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788940329.481111:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788940329.481123:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f082ad3400/0x27a633fcdd4aa00 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4aa07 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940329.481136:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f082ad3400/0x27a633fcdd4aa00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4aa07 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940329.484626:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788940329.484635:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1788940329.484640:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788940329.484687:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f181520e00/0x27a633fcdd4aa0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940329.484699:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f181520e00/0x27a633fcdd4aa0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940329.484711:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f181520e00/0x27a633fcdd4aa0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940329.484736:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738204160:0@lo:101: 00000100:00100000:2.0:1788940329.484816:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940329.484858:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f187966540 going to sleep for 11 seconds 00000100:00100000:0.0:1788940329.486006:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738204160 00000100:00100000:0.0:1788940329.486018:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738204160 00000100:00100000:0.0:1788940329.486078:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788940329.486088:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18415c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+14:5858:x1875839738204160:12345-0@lo:101: 00010000:00010000:0.0:1788940329.486104:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940329.486119:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f082ad3600/0x27a633fcdd4aa15 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4aa0e expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940329.486148:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f082ad3600/0x27a633fcdd4aa15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4aa0e expref: 15 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940329.486161:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f082ad3600/0x27a633fcdd4aa15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4aa0e expref: 15 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940329.486178:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f082ad3600, rc 0) 00000100:00100000:0.0:1788940329.486234:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18415c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+15:5858:x1875839738204160:12345-0@lo:101: Request processed in 147us (1417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940329.486256:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788940329.486610:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738204160:0@lo:101: 00010000:00010000:2.0:1788940329.486629:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f181520e00/0x27a633fcdd4aa0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4aa15 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940329.486638:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f181520e00/0x27a633fcdd4aa0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4aa15 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940329.486698:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738204288:0@lo:501: 00000100:00100000:2.0:1788940329.486736:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940329.486759:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f187966540 going to sleep for 11 seconds 00000100:00100000:0.0:1788940329.486813:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738204288 00000100:00100000:0.0:1788940329.486817:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738204288 00000100:00100000:0.0:1788940329.486853:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788940329.486862:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18415e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+15:5858:x1875839738204288:12345-0@lo:501: 00000100:00100000:0.0:1788940329.487108:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18415e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+15:5858:x1875839738204288:12345-0@lo:501: Request processed in 247us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940329.487116:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788940329.487203:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738204288:0@lo:501: 00000100:00100000:2.0:1788940329.487233:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738204416:0@lo:503: 00000100:00100000:2.0:1788940329.487465:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940329.487488:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f187966540 going to sleep for 11 seconds 00000100:00100000:0.0:1788940329.487543:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738204416 00000100:00100000:0.0:1788940329.487549:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738204416 00000100:00100000:0.0:1788940329.487577:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788940329.487584:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18415fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+15:5858:x1875839738204416:12345-0@lo:503: 00000100:00100000:0.0:1788940329.487783:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18415fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+15:5858:x1875839738204416:12345-0@lo:503: Request processed in 199us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940329.487790:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788940329.488933:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738204416:0@lo:503: 00000100:00100000:0.0:1788940329.489873:0:8063:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:8063:1875839738204544:0@lo:502: 00000100:00100000:0.0:1788940329.489957:0:8063:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940329.490000:0:8063:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1aeec6e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788940329.490044:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738204544 00000100:00100000:3.0:1788940329.490052:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738204544 00000100:00100000:3.0:1788940329.490101:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788940329.490110:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18415d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+15:8063:x1875839738204544:12345-0@lo:502: 00000100:00100000:3.0:1788940329.490602:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18415d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+15:8063:x1875839738204544:12345-0@lo:502: Request processed in 491us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940329.490610:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788940329.490709:0:8063:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:8063:1875839738204544:0@lo:502: 00000020:01000000:0.0:1788940329.490738:0:8063:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788940329.490747:0:8063:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940329.490749:0:8063:0:(obd_config.c:1662:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788940329.490760:0:8063:0:(obd_config.c:1571:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788940329.490763:0:8063:0:(obd_config.c:1636:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788940329.490783:0:8063:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:8063:1875839738204672:0@lo:502: 00000100:00100000:0.0:1788940329.490816:0:8063:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940329.490842:0:8063:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1aeec6e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788940329.490957:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738204672 00000100:00100000:3.0:1788940329.490963:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738204672 00000100:00100000:3.0:1788940329.490997:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788940329.491005:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+15:8063:x1875839738204672:12345-0@lo:502: 00000100:00100000:3.0:1788940329.491220:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+15:8063:x1875839738204672:12345-0@lo:502: Request processed in 215us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940329.491228:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788940329.505603:0:8063:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:8063:1875839738204672:0@lo:502: 00000020:01000000:2.0:1788940329.505774:0:8063:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788940329.505784:0:8063:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940329.505787:0:8063:0:(obd_config.c:1662:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788940329.505791:0:8063:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1788940329.505985:0:5858:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1788940329.506008:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788940329.506019:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f181520e00/0x27a633fcdd4aa0e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4aa15 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940329.506031:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f181520e00/0x27a633fcdd4aa0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4aa15 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940329.506043:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788940329.506045:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff89f188f09000 from 30 10000000:01000000:1.0:1788940329.506048:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788940329.506088:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f1c21f0e00/0x27a633fcdd4aa1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940329.506097:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f1c21f0e00/0x27a633fcdd4aa1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940329.506107:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f1c21f0e00/0x27a633fcdd4aa1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940329.506129:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4cd0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738204800:0@lo:101: 00000100:00100000:1.0:1788940329.506220:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940329.507567:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738204800 00000100:00100000:2.0:1788940329.507582:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738204800 00000100:00100000:2.0:1788940329.507660:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788940329.507672:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+15:5858:x1875839738204800:12345-0@lo:101: 00010000:00010000:2.0:1788940329.507689:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940329.507708:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f181521e00/0x27a633fcdd4aa23 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4aa1c expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940329.507754:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f181521e00/0x27a633fcdd4aa23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4aa1c expref: 16 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940329.507767:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f181521e00/0x27a633fcdd4aa23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4aa1c expref: 16 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940329.507777:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f181521e00, rc 0) 00000100:00100000:2.0:1788940329.510002:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+16:5858:x1875839738204800:12345-0@lo:101: Request processed in 2321us (3771us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940329.510015:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788940329.510987:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1a974d300 going to sleep for 11 seconds 00000100:00100000:1.0:1788940329.511021:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4cd0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738204800:0@lo:101: 00010000:00010000:1.0:1788940329.511049:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f1c21f0e00/0x27a633fcdd4aa1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4aa23 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940329.511062:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f1c21f0e00/0x27a633fcdd4aa1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4aa23 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940329.511141:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4cd0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738204928:0@lo:501: 00000100:00100000:1.0:1788940329.511205:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940329.511220:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1a974d300 going to sleep for 11 seconds 00000100:00100000:0.0:1788940329.511346:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738204928 00000100:00100000:0.0:1788940329.511355:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738204928 00000100:00100000:0.0:1788940329.511412:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788940329.511422:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+16:5858:x1875839738204928:12345-0@lo:501: 00000100:00100000:0.0:1788940329.511721:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+16:5858:x1875839738204928:12345-0@lo:501: Request processed in 300us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940329.511728:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788940329.511881:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4cd0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738204928:0@lo:501: 00000100:00100000:1.0:1788940329.511914:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4cd0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738205056:0@lo:503: 00000100:00100000:1.0:1788940329.511969:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940329.512002:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1a974d300 going to sleep for 11 seconds 00000100:00100000:2.0:1788940329.512075:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738205056 00000100:00100000:2.0:1788940329.512080:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738205056 00000100:00100000:2.0:1788940329.512104:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788940329.512111:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+16:5858:x1875839738205056:12345-0@lo:503: 00000100:00100000:2.0:1788940329.512268:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+16:5858:x1875839738205056:12345-0@lo:503: Request processed in 156us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940329.512275:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788940329.512423:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4cd0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738205056:0@lo:503: 00000100:00100000:1.0:1788940329.512817:0:8066:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4cd0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:8066:1875839738205184:0@lo:502: 00000100:00100000:1.0:1788940329.512854:0:8066:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940329.512884:0:8066:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1a974d780 going to sleep for 11 seconds 00000100:00100000:2.0:1788940329.512929:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738205184 00000100:00100000:2.0:1788940329.512934:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738205184 00000100:00100000:2.0:1788940329.512974:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788940329.512982:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+16:8066:x1875839738205184:12345-0@lo:502: 00000100:00100000:2.0:1788940329.513146:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+16:8066:x1875839738205184:12345-0@lo:502: Request processed in 164us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940329.513152:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788940329.513320:0:8066:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4cd0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:8066:1875839738205184:0@lo:502: 00000100:00100000:1.0:1788940329.513367:0:8066:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4cd0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:8066:1875839738205312:0@lo:502: 00000100:00100000:1.0:1788940329.513599:0:8066:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940329.513613:0:8066:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1a974d780 going to sleep for 11 seconds 00000100:00100000:2.0:1788940329.513685:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738205312 00000100:00100000:2.0:1788940329.513689:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738205312 00000100:00100000:2.0:1788940329.513713:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788940329.513726:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+16:8066:x1875839738205312:12345-0@lo:502: 00000100:00100000:2.0:1788940329.513857:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+16:8066:x1875839738205312:12345-0@lo:502: Request processed in 131us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940329.513864:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788940329.514055:0:8066:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4cd0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:8066:1875839738205312:0@lo:502: 00000040:00080000:1.0:1788940329.514082:0:8066:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1788940329.514317:0:5858:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788940329.514336:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788940329.514346:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f1c21f0e00/0x27a633fcdd4aa1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4aa23 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940329.514357:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f1c21f0e00/0x27a633fcdd4aa1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4aa23 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940329.514366:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788940329.514368:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff89f188f09000 from 5 10000000:01000000:2.0:1788940329.514371:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788940329.514414:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f181521000/0x27a633fcdd4aa2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940329.514422:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f181521000/0x27a633fcdd4aa2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940329.514430:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f181521000/0x27a633fcdd4aa2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940329.514443:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738205440:0@lo:101: 00000100:00100000:2.0:1788940329.514476:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940329.514509:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1a973ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1788940329.515382:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738205440 00000100:00100000:0.0:1788940329.515401:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738205440 00000100:00100000:0.0:1788940329.515453:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788940329.515465:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+16:5858:x1875839738205440:12345-0@lo:101: 00010000:00010000:0.0:1788940329.515478:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940329.515495:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f082ad3a00/0x27a633fcdd4aa31 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4aa2a expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940329.515546:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f082ad3a00/0x27a633fcdd4aa31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4aa2a expref: 17 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940329.515558:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f082ad3a00/0x27a633fcdd4aa31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4aa2a expref: 17 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940329.515566:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f082ad3a00, rc 0) 00000100:00100000:0.0:1788940329.515627:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+17:5858:x1875839738205440:12345-0@lo:101: Request processed in 164us (1149us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940329.515643:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788940329.515705:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738205440:0@lo:101: 00010000:00010000:0.0:1788940329.515720:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f181521000/0x27a633fcdd4aa2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4aa31 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940329.515730:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f181521000/0x27a633fcdd4aa2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4aa31 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940329.515793:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738205568:0@lo:256: 00000100:00100000:0.0:1788940329.515834:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940329.515861:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1aeec6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788940329.515875:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738205568 00000100:00100000:0.0:1788940329.515879:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738205568 00000100:00100000:0.0:1788940329.515901:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788940329.515908:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+17:5858:x1875839738205568:12345-0@lo:256: 20000000:01000000:0.0:1788940329.515923:0:5853:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788940329.515955:0:5853:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788940329.515958:0:5853:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1788940329.516033:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+17:5858:x1875839738205568:12345-0@lo:256: Request processed in 125us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940329.516040:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788940329.516071:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738205568:0@lo:256: 10000000:01000000:0.0:1788940329.516109:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788940329.516118:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f181521000/0x27a633fcdd4aa2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4aa31 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940329.516127:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f181521000/0x27a633fcdd4aa2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4aa31 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940329.516141:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788940329.516143:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1788940329.516145:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788940329.516324:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f082ad2c00/0x27a633fcdd4aa38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940329.516332:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f082ad2c00/0x27a633fcdd4aa38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940329.516340:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f082ad2c00/0x27a633fcdd4aa38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940329.516352:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738205696:0@lo:101: 00000100:00100000:0.0:1788940329.516378:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940329.516403:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1aeec6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788940329.516417:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738205696 00000100:00100000:0.0:1788940329.516420:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738205696 00000100:00100000:0.0:1788940329.516439:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788940329.516444:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+17:5858:x1875839738205696:12345-0@lo:101: 00010000:00010000:0.0:1788940329.516451:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940329.516460:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f082ad2400/0x27a633fcdd4aa3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4aa38 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940329.516475:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f082ad2400/0x27a633fcdd4aa3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4aa38 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940329.516483:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f082ad2400/0x27a633fcdd4aa3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4aa38 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940329.516501:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f082ad2400, rc 0) 00000100:00100000:0.0:1788940329.516554:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+18:5858:x1875839738205696:12345-0@lo:101: Request processed in 108us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940329.516559:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788940329.516590:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738205696:0@lo:101: 00010000:00010000:0.0:1788940329.516600:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f082ad2c00/0x27a633fcdd4aa38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4aa3f expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940329.516607:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f082ad2c00/0x27a633fcdd4aa38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4aa3f expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940329.516647:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738205824:0@lo:501: 00000100:00100000:0.0:1788940329.516671:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940329.516684:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1aeec6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788940329.516695:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738205824 00000100:00100000:0.0:1788940329.516698:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738205824 00000100:00100000:0.0:1788940329.516715:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788940329.516722:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+18:5858:x1875839738205824:12345-0@lo:501: 00000100:00100000:0.0:1788940329.516982:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+18:5858:x1875839738205824:12345-0@lo:501: Request processed in 259us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940329.516989:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788940329.517017:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738205824:0@lo:501: 00000100:00100000:0.0:1788940329.517043:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738205952:0@lo:503: 00000100:00100000:0.0:1788940329.517078:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940329.517090:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1aeec6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788940329.517105:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738205952 00000100:00100000:0.0:1788940329.517109:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738205952 00000100:00100000:0.0:1788940329.517124:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788940329.517129:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+18:5858:x1875839738205952:12345-0@lo:503: 00000100:00100000:0.0:1788940329.518713:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+18:5858:x1875839738205952:12345-0@lo:503: Request processed in 1575us (1627us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940329.518725:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788940329.518796:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738205952:0@lo:503: 00000100:00100000:3.0:1788940329.522068:0:8067:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b48a6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:8067:1875839738206080:0@lo:502: 00000100:00100000:3.0:1788940329.522161:0:8067:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940329.522336:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738206080 00000100:00100000:1.0:1788940329.522346:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738206080 00000100:00100000:1.0:1788940329.522469:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788940329.522480:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+18:8067:x1875839738206080:12345-0@lo:502: 00000100:00100000:1.0:1788940329.524353:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+18:8067:x1875839738206080:12345-0@lo:502: Request processed in 1868us (2185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940329.524365:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788940329.530844:0:8067:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f19068a300 going to sleep for 11 seconds 00000100:00100000:3.0:1788940329.530894:0:8067:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b48a6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:8067:1875839738206080:0@lo:502: 00000020:01000000:3.0:1788940329.530951:0:8067:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788940329.530960:0:8067:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788940329.530971:0:8067:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940329.530973:0:8067:0:(obd_config.c:1662:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788940329.530979:0:8067:0:(obd_config.c:1571:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788940329.530983:0:8067:0:(obd_config.c:1586:class_process_config()) adding mapping from uuid 192.168.202.114@tcp to nid 0x20000c0a8ca72 (192.168.202.114@tcp) 00000020:01000000:3.0:1788940329.531007:0:8067:0:(obd_config.c:2073:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788940329.531010:0:8067:0:(obd_config.c:1571:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788940329.531027:0:8067:0:(genops.c:415:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff89f1bf86cd88) 00000020:00000080:3.0:1788940329.531051:0:8067:0:(obd_config.c:786:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1788940329.531056:0:8067:0:(obd_config.c:1571:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788940329.531170:0:8067:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788940329.531176:0:8067:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788940329.531198:0:8067:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x27a633fcdd4aa4d 00010000:00080000:3.0:1788940329.531231:0:8067:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89f1b4d02800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.114@tcp at head 00010000:00010000:3.0:1788940329.533732:0:8067:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:3.0:1788940329.534101:0:8067:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1788940329.534114:0:8067:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788940329.536697:0:8067:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788940329.536965:0:8067:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788940329.537026:0:8067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1788940329.537092:0:8067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1788940329.539116:0:8068:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788940329.539123:0:8068:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788940329.546951:0:8067:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788940329.546968:0:8067:0:(obd_config.c:1571:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788940329.547016:0:8067:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788940329.547040:0:8067:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x27a633fcdd4aa54 00000100:00080000:0.0:1788940329.547052:0:8067:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788940329.547059:0:8067:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff89f1b4d02800 using connection 192.168.202.114@tcp/0@lo 00000100:00100000:0.0:1788940329.547106:0:8067:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89f0821c0a80 x1875839738206208/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788940329.547134:0:8067:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1788940329.547221:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875839738206208:0@lo:8: 00000100:00100000:2.0:1788940329.547302:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940329.547375:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738206208 00000100:00100000:2.0:1788940329.547385:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738206208 00000100:00100000:2.0:1788940329.547432:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788940329.547440:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3304:x1875839738206208:12345-0@lo:8: 00010000:00080000:2.0:1788940329.547469:0:6708:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 272 last 0 00000020:00000080:2.0:1788940329.547492:0:6708:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x27a633fcdd4aa5b 00002000:00100000:2.0:1788940329.547505:0:6708:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff89f1ba91f800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788940329.547509:0:6708:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1788940329.547512:0:6708:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1788940329.547654:0:6708:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788940329.547803:0:6708:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788940329.547830:0:6708:0:(import.c:65:import_set_state_nolock()) ffff89f1ba91a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788940329.547886:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1875839738206208:12345-0@lo:8: Request processed in 445us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940329.547893:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788940329.547950:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f0821c0a80 x1875839738206208/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788940339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940329.547959:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788940329.547966:0:3304:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788940329.547975:0:3304:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788940329.547979:0:3304:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788940329.547982:0:3304:0:(import.c:65:import_set_state_nolock()) ffff89f1b4d02800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788940329.547997:0:3304:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788940329.548002:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875839738206208:0@lo:8: 00000004:00080000:1.0:1788940329.550405:0:8068:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788940329.550564:0:8068:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 272449045122ns, next at 0ns, rc = 0 00000020:01000000:0.0:1788940329.554294:0:8067:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788940329.554302:0:8067:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940329.554304:0:8067:0:(obd_config.c:1662:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788940329.554308:0:8067:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788940329.554314:0:8067:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940329.554315:0:8067:0:(obd_config.c:1662:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788940329.554319:0:8067:0:(obd_config.c:1571:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788940329.554321:0:8067:0:(obd_config.c:1636:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788940329.554374:0:8067:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:8067:1875839738206336:0@lo:502: 00000100:00100000:3.0:1788940329.554836:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b48a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875839738206848:0@lo:400: 00000100:00100000:1.0:1788940329.554958:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b48a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875839738206464:0@lo:400: 00000100:00100000:0.0:1788940329.557952:0:8067:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940329.557996:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738206336 00000100:00100000:0.0:1788940329.558006:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738206336 00000100:00100000:0.0:1788940329.558061:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788940329.558072:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+18:8067:x1875839738206336:12345-0@lo:502: 00000100:00100000:0.0:1788940329.558341:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+18:8067:x1875839738206336:12345-0@lo:502: Request processed in 270us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940329.558349:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788940329.558409:0:8067:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1a1490900 going to sleep for 11 seconds 00000100:00100000:0.0:1788940329.558437:0:8067:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:8067:1875839738206336:0@lo:502: 00000020:01000000:0.0:1788940329.558471:0:8067:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788940329.558479:0:8067:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940329.558482:0:8067:0:(obd_config.c:1662:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788940329.558487:0:8067:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1788940329.558579:0:5858:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1788940329.558601:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788940329.558611:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f082ad2c00/0x27a633fcdd4aa38 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4aa3f expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940329.558623:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f082ad2c00/0x27a633fcdd4aa38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4aa3f expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940329.558635:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788940329.558637:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff89f1982e0000 from 1 10000000:01000000:0.0:1788940329.558640:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788940329.558674:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f082ad2800/0x27a633fcdd4aa62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940329.558682:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f082ad2800/0x27a633fcdd4aa62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940329.558698:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f082ad2800/0x27a633fcdd4aa62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940329.558717:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738206976:0@lo:101: 00000100:00100000:0.0:1788940329.559372:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940329.559396:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1a1490900 going to sleep for 11 seconds 00000100:00100000:0.0:1788940329.559415:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738206976 00000100:00100000:0.0:1788940329.559419:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738206976 00000100:00100000:0.0:1788940329.559445:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788940329.559452:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+18:5858:x1875839738206976:12345-0@lo:101: 00010000:00010000:0.0:1788940329.559460:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940329.559474:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f082ad2200/0x27a633fcdd4aa69 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4aa62 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940329.559498:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f082ad2200/0x27a633fcdd4aa69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4aa62 expref: 19 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940329.559510:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f082ad2200/0x27a633fcdd4aa69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4aa62 expref: 19 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940329.559540:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f082ad2200, rc 0) 00000100:00100000:0.0:1788940329.559568:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:5858:x1875839738206976:12345-0@lo:101: Request processed in 116us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940329.559574:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788940329.559607:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738206976:0@lo:101: 00010000:00010000:0.0:1788940329.559621:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f082ad2800/0x27a633fcdd4aa62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4aa69 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940329.559641:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f082ad2800/0x27a633fcdd4aa62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4aa69 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940329.559692:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738207104:0@lo:501: 00000100:00100000:0.0:1788940329.559721:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940329.559735:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1a1490900 going to sleep for 11 seconds 00000100:00100000:0.0:1788940329.559746:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738207104 00000100:00100000:0.0:1788940329.559749:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738207104 00000100:00100000:0.0:1788940329.559769:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788940329.559775:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:5858:x1875839738207104:12345-0@lo:501: 00000100:00100000:0.0:1788940329.559982:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:5858:x1875839738207104:12345-0@lo:501: Request processed in 206us (259us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788940329.559989:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788940329.560020:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738207104:0@lo:501: 10000000:01000000:0.0:1788940329.560041:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788940329.560047:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f082ad2800/0x27a633fcdd4aa62 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4aa69 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940329.560053:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f082ad2800/0x27a633fcdd4aa62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4aa69 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940329.562736:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940329.562854:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b48a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875839738206592:0@lo:400: 00000100:00100000:3.0:1788940329.562913:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940329.562945:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788940329.562953:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b48a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738206720:0@lo:400: 00000100:00100000:3.0:1788940329.562977:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940329.563015:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738206848 00000100:00100000:3.0:1788940329.563023:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738206848 00000100:00100000:3.0:1788940329.563076:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738206592 00000100:00100000:3.0:1788940329.563079:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738206592 00000100:00100000:3.0:1788940329.563100:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788940329.563110:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b500dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875839738206848:12345-0@lo:400: 00000100:00100000:3.0:1788940329.563168:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b500dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875839738206848:12345-0@lo:400: Request processed in 59us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940329.563176:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788940329.563211:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788940329.563217:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b500ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875839738206592:12345-0@lo:400: 00000100:00100000:3.0:1788940329.563264:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b500ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875839738206592:12345-0@lo:400: Request processed in 47us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940329.563270:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788940329.563289:0:7074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738206720 00000100:00100000:3.0:1788940329.563292:0:7074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738206720 00000100:00100000:3.0:1788940329.563318:0:7074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788940329.563324:0:7074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b500f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738206720:12345-0@lo:400: 00000100:00100000:3.0:1788940329.563354:0:7074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b500f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738206720:12345-0@lo:400: Request processed in 30us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940329.563370:0:7074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1788940329.563402:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788940329.563438:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1b48a5f80 x1875839738206848/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940329.563453:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b48a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875839738206848:0@lo:400: 00010000:00080000:3.0:1788940329.563485:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1b48a7b80 x1875839738206720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940329.563494:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b48a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738206720:0@lo:400: 00010000:00080000:3.0:1788940329.563505:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1b48a5c00 x1875839738206592/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940329.563512:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b48a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875839738206592:0@lo:400: 00000100:00100000:3.0:1788940329.563555:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940329.563586:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738206464 00000100:00100000:3.0:1788940329.563590:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738206464 00000100:00100000:3.0:1788940329.563611:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788940329.563616:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b500f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875839738206464:12345-0@lo:400: 00000100:00100000:3.0:1788940329.563651:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b500f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875839738206464:12345-0@lo:400: Request processed in 35us (96us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940329.563658:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1788940329.563684:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1b48a6d80 x1875839738206464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940329.563693:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b48a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875839738206464:0@lo:400: 00000004:00080000:2.0:1788940329.622739:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:0.0:1788940329.645351:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788940329.687479:0:8069:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1788940329.687537:0:8069:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8069:1875839738207360:0@lo:7: 00000100:00100000:2.0:1788940329.687823:0:8069:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940329.687876:0:8069:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1863f0900 going to sleep for 11 seconds 00000100:00100000:2.0:1788940329.687903:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788940329.687914:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738207232:0@lo:13: 00000100:00100000:2.0:1788940329.687951:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940329.687980:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738207360 00000100:00100000:2.0:1788940329.687989:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738207360 00000100:00100000:2.0:1788940329.688048:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788940329.688059:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8069:x1875839738207360:12345-0@lo:7: 00000100:00080000:0.0:1788940329.689724:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788940329.689752:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738207232 00000100:00100000:0.0:1788940329.689761:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738207232 00000100:00100000:0.0:1788940329.689810:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788940329.689817:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1875839738207232:12345-0@lo:13: 00002000:00000024:0.0:1788940329.689853:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1788940329.689924:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1875839738207232:12345-0@lo:13: Request processed in 108us (1973us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940329.689930:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788940329.701650:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1b5c6d180 x1875839738207232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940345 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940329.701680:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738207232:0@lo:13: 00002000:00080000:2.0:1788940329.714244:0:6708:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1788940329.714254:0:6708:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1788940329.714828:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8069:x1875839738207360:12345-0@lo:7: Request processed in 26764us (26999us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940329.714841:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788940329.714898:0:8069:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1b5c6e680 x1875839738207360/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788940345 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940329.714915:0:8069:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8069:1875839738207360:0@lo:7: 00000004:00080000:2.0:1788940329.714931:0:8069:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1788940329.714985:0:8069:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8069:1875839738207488:0@lo:5: 00000100:00100000:2.0:1788940329.715024:0:8069:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940329.715068:0:8069:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1a1490900 going to sleep for 11 seconds 00000100:00100000:2.0:1788940329.715092:0:7074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738207488 00000100:00100000:2.0:1788940329.715099:0:7074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738207488 00000100:00100000:2.0:1788940329.715144:0:7074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788940329.715152:0:7074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8069:x1875839738207488:12345-0@lo:5: 00002000:00080000:2.0:1788940329.715179:0:7074:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1788940329.715183:0:7074:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1788940329.715865:0:7074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:8069:x1875839738207488:12345-0@lo:5: Request processed in 711us (838us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788940329.715874:0:7074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788940329.715913:0:8069:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1b5c6e680 x1875839738207488/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788940345 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940329.715926:0:8069:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8069:1875839738207488:0@lo:5: 00000004:00080000:2.0:1788940329.715949:0:8069:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1788940329.715979:0:8069:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8069:1875839738207616:0@lo:700: 00000100:00100000:2.0:1788940329.716008:0:8069:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940329.716066:0:8069:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1863f0900 going to sleep for 11 seconds 00000100:00100000:1.0:1788940329.716103:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738207616 00000100:00100000:1.0:1788940329.716109:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738207616 00000100:00100000:1.0:1788940329.716175:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788940329.716184:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8069:x1875839738207616:12345-0@lo:700: 00000100:00100000:1.0:1788940329.716212:0:6714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4cd0000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6714:1875839738207744:0@lo:700: 00000100:00100000:1.0:1788940329.716241:0:6714:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940329.716258:0:6714:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f19860d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788940329.716270:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738207744 00000100:00100000:1.0:1788940329.716273:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738207744 00000100:00100000:1.0:1788940329.716298:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788940329.716304:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6714:x1875839738207744:12345-0@lo:700: 40000000:02000000:1.0:1788940329.798170:0:5867:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1788940329.811822:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6714:x1875839738207744:12345-0@lo:700: Request processed in 95507us (95569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940329.811838:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788940329.812578:0:6714:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1b4cd0000 x1875839738207744/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788940345 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940329.812595:0:6714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4cd0000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6714:1875839738207744:0@lo:700: 40000000:02000000:0.0:1788940329.812610:0:6714:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:2.0:1788940329.919381:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8069:x1875839738207616:12345-0@lo:700: Request processed in 203185us (203360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940329.919474:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788940329.919561:0:8069:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1b5c6fb80 x1875839738207616/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788940345 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940329.919649:0:8069:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8069:1875839738207616:0@lo:700: 00000001:00080000:1.0:1788940329.920695:0:7662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:1.0:1788940329.920712:0:7662:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000004:02000040:2.0:1788940329.953952:0:8069:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1788940329.969783:0:8069:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b500fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8069:1875839738207872:0@lo:5: 00000100:00100000:3.0:1788940329.969866:0:8069:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940329.969923:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738207872 00000100:00100000:3.0:1788940329.969943:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738207872 00000100:00100000:3.0:1788940329.969999:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788940329.970009:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b500ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8069:x1875839738207872:12345-0@lo:5: 00000100:00100000:2.0:1788940329.973813:0:8069:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f186823840 going to sleep for 11 seconds 00002000:00080000:3.0:1788940329.980410:0:6707:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1788940329.980432:0:6707:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1788940329.988811:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b500ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8069:x1875839738207872:12345-0@lo:5: Request processed in 18794us (18936us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788940329.988825:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788940329.989074:0:8069:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1b500fb80 x1875839738207872/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788940345 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940329.989086:0:8069:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788940329.989101:0:8069:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff89f1b500fb80 x1875839738207872/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788940345 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940329.989110:0:8069:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b500fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8069:1875839738207872:0@lo:5: 00000004:00080000:0.0:1788940329.989124:0:8069:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:1.0:1788940330.669537:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940331.700818:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940332.718838:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940333.550052:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738208000:0@lo:13: 00000100:00100000:3.0:1788940333.550129:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940333.550305:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738208000 00000100:00100000:2.0:1788940333.550314:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738208000 00000100:00100000:2.0:1788940333.550396:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788940333.550408:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b500ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738208000:12345-0@lo:13: 00002000:00000024:2.0:1788940333.550446:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788940333.550502:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b500ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738208000:12345-0@lo:13: Request processed in 97us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940333.550561:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788940333.550605:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1b5c6fb80 x1875839738208000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940349 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940333.550633:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738208000:0@lo:13: 00000100:00080000:0.0:1788940333.550812:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788940333.743460:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788940334.418804:0:7662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:3.0:1788940334.575842:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b500e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3306:1875839738208128:0@lo:400: 00000100:00100000:1.0:1788940334.576160:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b500ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875839738208256:0@lo:400: 00000100:00100000:1.0:1788940334.576211:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940334.576271:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b500d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738208768:0@lo:400: 00000100:00100000:1.0:1788940334.576296:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940334.576329:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788940334.576335:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b500e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875839738208384:0@lo:400: 00000100:00100000:1.0:1788940334.576369:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940334.576402:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738208768 00000100:00100000:1.0:1788940334.576411:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738208768 00000100:00100000:1.0:1788940334.576470:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788940334.576489:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4cd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738208768:12345-0@lo:400: 00000100:00100000:1.0:1788940334.576570:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4cd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738208768:12345-0@lo:400: Request processed in 90us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940334.576578:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788940334.576602:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738208256 00000100:00100000:1.0:1788940334.576606:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738208256 00000100:00100000:1.0:1788940334.576630:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738208384 00000100:00100000:1.0:1788940334.576633:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738208384 00000100:00100000:1.0:1788940334.576654:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788940334.576661:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4cd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875839738208256:12345-0@lo:400: 00000100:00100000:1.0:1788940334.576703:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4cd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875839738208256:12345-0@lo:400: Request processed in 43us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940334.576710:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788940334.576722:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788940334.576728:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875839738208384:12345-0@lo:400: 00000100:00100000:1.0:1788940334.576753:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875839738208384:12345-0@lo:400: Request processed in 25us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940334.576758:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1788940334.576776:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788940334.576780:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788940334.576819:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1b500e680 x1875839738208384/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940350 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940334.576833:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b500e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875839738208384:0@lo:400: 00010000:00080000:1.0:1788940334.576843:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1b500ce00 x1875839738208256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940350 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940334.576852:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b500ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875839738208256:0@lo:400: 00010000:00080000:1.0:1788940334.576862:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1b500d500 x1875839738208768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940350 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940334.576869:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788940334.576884:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b500d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738208768:0@lo:400: 00000100:00100000:3.0:1788940334.577419:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940334.577457:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b500d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875839738208640:0@lo:400: 00000100:00100000:3.0:1788940334.577634:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940334.577655:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788940334.577662:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b500c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738208512:0@lo:400: 00000100:00100000:3.0:1788940334.577689:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940334.577727:0:7074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738208512 00000100:00100000:3.0:1788940334.577731:0:7074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738208512 00000100:00100000:3.0:1788940334.577765:0:7074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788940334.577772:0:7074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b500f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738208512:12345-0@lo:400: 00000100:00100000:3.0:1788940334.577812:0:7074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b500f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738208512:12345-0@lo:400: Request processed in 40us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940334.577817:0:7074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788940334.577848:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1b500c380 x1875839738208512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940350 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940334.577871:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b500c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738208512:0@lo:400: 00000100:00100000:1.0:1788940334.578804:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738208640 00000100:00100000:1.0:1788940334.578813:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738208640 00000100:00100000:1.0:1788940334.578863:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788940334.578873:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b500c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875839738208640:12345-0@lo:400: 00000100:00100000:1.0:1788940334.578950:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b500c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875839738208640:12345-0@lo:400: Request processed in 80us (1316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940334.578964:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1788940334.578991:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788940334.579098:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738208128 00000100:00100000:0.0:1788940334.579103:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738208128 00000100:00100000:0.0:1788940334.579133:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788940334.579141:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3306:x1875839738208128:12345-0@lo:400: 00000100:00100000:0.0:1788940334.579179:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3306:x1875839738208128:12345-0@lo:400: Request processed in 38us (1761us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940334.579185:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788940334.579274:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b500e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3306:1875839738208128:0@lo:400: 00010000:00080000:3.0:1788940334.579287:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1b500d180 x1875839738208640/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940350 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940334.579297:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b500d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875839738208640:0@lo:400: 00010000:00010000:3.0:1788940334.765367:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940335.085990:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788940335.086221:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738208896:0@lo:13: 00000100:00100000:0.0:1788940335.086471:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940335.086636:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738208896 00000100:00100000:2.0:1788940335.086646:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738208896 00000100:00100000:2.0:1788940335.086698:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788940335.086709:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f0821c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738208896:12345-0@lo:13: 00002000:00000024:2.0:1788940335.086750:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788940335.086797:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f0821c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738208896:12345-0@lo:13: Request processed in 90us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940335.086804:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788940335.086914:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f0821c3100 x1875839738208896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940351 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940335.086935:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738208896:0@lo:13: 00000100:00100000:2.0:1788940335.282102:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940335.282933:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718260864 00000100:00100000:2.0:1788940335.282949:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718260864 00000100:00100000:2.0:1788940335.283010:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 115 00000100:00100000:2.0:1788940335.283021:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18416d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2349:x1875839718260864:12345-192.168.202.14@tcp:250: 00010000:00080000:2.0:1788940335.283144:0:5855:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from f0b05a86-29c8-44a6-9c64-75d9d650043e@192.168.202.14@tcp t0 exp 0000000000000000 cur 278 last 0 00000020:00000080:2.0:1788940335.283176:0:5855:0:(genops.c:1393:class_connect()) connect: client f0b05a86-29c8-44a6-9c64-75d9d650043e, cookie 0x27a633fcdd4aa70 00000100:00080000:2.0:1788940335.283611:0:5855:0:(import.c:65:import_set_state_nolock()) ffff89f1ba91e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788940335.283762:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18416d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+5:2349:x1875839718260864:12345-192.168.202.14@tcp:250: Request processed in 740us (1678us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940335.283770:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 115 00000100:00100000:3.0:1788940335.307942:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940335.308197:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718260992 00000100:00100000:0.0:1788940335.308213:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718260992 00000100:00100000:0.0:1788940335.308290:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 116 00000100:00100000:0.0:1788940335.308303:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18416f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0b05a86-29c8-44a6-9c64-75d9d650043e+5:5584:x1875839718260992:12345-192.168.202.14@tcp:101: 00010000:00010000:0.0:1788940335.308322:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940335.308350:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f082ad3000/0x27a633fcdd4aa77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f563f expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940335.308386:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f082ad3000/0x27a633fcdd4aa77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f563f expref: 6 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940335.308398:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f082ad3000/0x27a633fcdd4aa77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f563f expref: 6 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940335.308410:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f082ad3000, rc 0) 00000100:00100000:0.0:1788940335.308486:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18416f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0b05a86-29c8-44a6-9c64-75d9d650043e+6:5584:x1875839718260992:12345-192.168.202.14@tcp:101: Request processed in 185us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940335.308493:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 116 00000100:00100000:0.0:1788940335.324862:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940335.324969:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718261120 00000100:00100000:2.0:1788940335.324982:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718261120 00000100:00100000:2.0:1788940335.325060:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 117 00000100:00100000:2.0:1788940335.325087:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18416e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+6:5584:x1875839718261120:12345-192.168.202.14@tcp:501: 00000100:00100000:2.0:1788940335.330460:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18416e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+6:5584:x1875839718261120:12345-192.168.202.14@tcp:501: Request processed in 5365us (5595us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788940335.330477:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 117 00000100:00100000:3.0:1788940335.335338:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940335.336219:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718261248 00000100:00100000:1.0:1788940335.336237:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718261248 00000100:00100000:1.0:1788940335.337228:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 118 00000100:00100000:1.0:1788940335.337247:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18416f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0b05a86-29c8-44a6-9c64-75d9d650043e+6:5584:x1875839718261248:12345-192.168.202.14@tcp:101: 00010000:00010000:1.0:1788940335.337271:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940335.337372:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f1c21f1000/0x27a633fcdd4aa7e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5646 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940335.337415:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f1c21f1000/0x27a633fcdd4aa7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5646 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940335.337429:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f1c21f1000/0x27a633fcdd4aa7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5646 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940335.337439:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f1c21f1000, rc 0) 00000100:00100000:1.0:1788940335.337550:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18416f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0b05a86-29c8-44a6-9c64-75d9d650043e+7:5584:x1875839718261248:12345-192.168.202.14@tcp:101: Request processed in 309us (2220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940335.337558:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 118 00000100:00100000:0.0:1788940335.346594:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940335.346711:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718261376 00000100:00100000:1.0:1788940335.346727:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718261376 00000100:00100000:1.0:1788940335.346796:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 119 00000100:00100000:1.0:1788940335.346811:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18416ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+7:5584:x1875839718261376:12345-192.168.202.14@tcp:501: 00000100:00100000:1.0:1788940335.347171:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18416ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+8:5584:x1875839718261376:12345-192.168.202.14@tcp:501: Request processed in 362us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940335.347179:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 119 00000100:00100000:1.0:1788940335.350202:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940335.350292:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718261504 00000100:00100000:2.0:1788940335.350309:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718261504 00000100:00100000:2.0:1788940335.350383:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 120 00000100:00100000:2.0:1788940335.350396:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18416dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0b05a86-29c8-44a6-9c64-75d9d650043e+8:5584:x1875839718261504:12345-192.168.202.14@tcp:503: 00000100:00100000:3.0:1788940335.351452:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18416dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0b05a86-29c8-44a6-9c64-75d9d650043e+8:5584:x1875839718261504:12345-192.168.202.14@tcp:503: Request processed in 1054us (1259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940335.351462:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 120 00000100:00100000:3.0:1788940335.356620:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940335.357617:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718261632 00000100:00100000:2.0:1788940335.357629:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718261632 00000100:00100000:2.0:1788940335.357687:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 121 00000100:00100000:2.0:1788940335.357699:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18416c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+8:5603:x1875839718261632:12345-192.168.202.14@tcp:502: 00000100:00100000:2.0:1788940335.358040:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18416c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+8:5603:x1875839718261632:12345-192.168.202.14@tcp:502: Request processed in 342us (1429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940335.358049:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 121 00000100:00100000:0.0:1788940335.388562:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940335.388704:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718261760 00000100:00100000:2.0:1788940335.388718:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718261760 00000100:00100000:2.0:1788940335.388779:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 122 00000100:00100000:2.0:1788940335.388790:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18416e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0b05a86-29c8-44a6-9c64-75d9d650043e+8:5603:x1875839718261760:12345-192.168.202.14@tcp:502: 00000100:00100000:2.0:1788940335.389088:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18416e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0b05a86-29c8-44a6-9c64-75d9d650043e+8:5603:x1875839718261760:12345-192.168.202.14@tcp:502: Request processed in 299us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940335.389109:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 122 00000100:00100000:1.0:1788940335.414655:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940335.414857:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718261888 00000100:00100000:2.0:1788940335.414872:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718261888 00000100:00100000:2.0:1788940335.414952:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 123 00000100:00100000:2.0:1788940335.414964:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18416c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0b05a86-29c8-44a6-9c64-75d9d650043e+8:5584:x1875839718261888:12345-192.168.202.14@tcp:101: 00010000:00010000:2.0:1788940335.415001:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940335.415023:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f181520800/0x27a633fcdd4aa85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5670 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940335.415054:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f181520800/0x27a633fcdd4aa85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5670 expref: 9 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940335.415065:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f181520800/0x27a633fcdd4aa85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5670 expref: 9 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940335.415073:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f181520800, rc 0) 00000100:00100000:2.0:1788940335.415153:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18416c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0b05a86-29c8-44a6-9c64-75d9d650043e+9:5584:x1875839718261888:12345-192.168.202.14@tcp:101: Request processed in 190us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940335.415159:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 123 00000100:00100000:2.0:1788940335.419587:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940335.419723:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718262016 00000100:00100000:1.0:1788940335.419733:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718262016 00000100:00100000:1.0:1788940335.419792:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 124 00000100:00100000:1.0:1788940335.419802:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18416e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+9:5584:x1875839718262016:12345-192.168.202.14@tcp:256: 20000000:01000000:1.0:1788940335.419831:0:5855:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788940335.419857:0:5855:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788940335.419861:0:5855:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788940335.419865:0:5855:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788940335.419867:0:5855:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1788940335.422077:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18416e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+9:5584:x1875839718262016:12345-192.168.202.14@tcp:256: Request processed in 2266us (2488us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940335.422102:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 124 00000100:00100000:3.0:1788940335.426251:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940335.426394:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718262144 00000100:00100000:0.0:1788940335.426405:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718262144 00000100:00100000:0.0:1788940335.426478:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 125 00000100:00100000:0.0:1788940335.426501:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18416fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0b05a86-29c8-44a6-9c64-75d9d650043e+9:5584:x1875839718262144:12345-192.168.202.14@tcp:101: 00010000:00010000:0.0:1788940335.426546:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940335.426566:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f082ad3800/0x27a633fcdd4aa8c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5677 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940335.426596:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f082ad3800/0x27a633fcdd4aa8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5677 expref: 10 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940335.426609:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f082ad3800/0x27a633fcdd4aa8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5677 expref: 10 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940335.426619:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f082ad3800, rc 0) 00000100:00100000:0.0:1788940335.426676:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18416fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0b05a86-29c8-44a6-9c64-75d9d650043e+10:5584:x1875839718262144:12345-192.168.202.14@tcp:101: Request processed in 177us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940335.426684:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 125 00000100:00100000:0.0:1788940335.431843:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940335.432606:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718262272 00000100:00100000:3.0:1788940335.432619:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718262272 00000100:00100000:3.0:1788940335.432679:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 126 00000100:00100000:3.0:1788940335.432688:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18416d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+10:5584:x1875839718262272:12345-192.168.202.14@tcp:501: 00000100:00100000:3.0:1788940335.432962:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18416d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+10:5584:x1875839718262272:12345-192.168.202.14@tcp:501: Request processed in 275us (1128us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940335.432970:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 126 00000100:00100000:3.0:1788940335.436467:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940335.436715:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718262400 00000100:00100000:1.0:1788940335.436731:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718262400 00000100:00100000:1.0:1788940335.436794:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 127 00000100:00100000:1.0:1788940335.436806:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18416cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0b05a86-29c8-44a6-9c64-75d9d650043e+10:5584:x1875839718262400:12345-192.168.202.14@tcp:503: 00000100:00100000:1.0:1788940335.437267:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18416cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0b05a86-29c8-44a6-9c64-75d9d650043e+10:5584:x1875839718262400:12345-192.168.202.14@tcp:503: Request processed in 461us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940335.437276:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 127 00000100:00100000:0.0:1788940335.447082:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940335.447507:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718262528 00000100:00100000:1.0:1788940335.447551:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718262528 00000100:00100000:1.0:1788940335.447613:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 128 00000100:00100000:1.0:1788940335.447623:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f188d36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0b05a86-29c8-44a6-9c64-75d9d650043e+10:5608:x1875839718262528:12345-192.168.202.14@tcp:502: 00000100:00100000:1.0:1788940335.447898:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f188d36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0b05a86-29c8-44a6-9c64-75d9d650043e+10:5608:x1875839718262528:12345-192.168.202.14@tcp:502: Request processed in 275us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940335.447906:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 128 00000100:00100000:0.0:1788940335.450813:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940335.457448:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718262656 00000100:00100000:3.0:1788940335.457465:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718262656 00000100:00100000:3.0:1788940335.457551:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 129 00000100:00100000:3.0:1788940335.457564:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f188d37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+10:5608:x1875839718262656:12345-192.168.202.14@tcp:502: 00000100:00100000:3.0:1788940335.457816:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f188d37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+10:5608:x1875839718262656:12345-192.168.202.14@tcp:502: Request processed in 254us (7011us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940335.457824:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 129 00000100:00100000:3.0:1788940335.460795:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940335.460896:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718262784 00000100:00100000:0.0:1788940335.460907:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718262784 00000100:00100000:0.0:1788940335.461009:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 4 00000100:00100000:0.0:1788940335.461019:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b500d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2349:x1875839718262784:12345-192.168.202.14@tcp:38: 00010000:00080000:0.0:1788940335.461063:0:5860:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 9c51ff78-d02d-4e61-8a10-a2f8830f1679@192.168.202.14@tcp t0 exp 0000000000000000 cur 278 last 0 00000020:00000080:0.0:1788940335.461111:0:5860:0:(genops.c:1393:class_connect()) connect: client 9c51ff78-d02d-4e61-8a10-a2f8830f1679, cookie 0x27a633fcdd4aa93 00000004:00100000:0.0:1788940335.461141:0:5860:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1788940335.461147:0:5860:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1788940335.502719:0:5860:0:(import.c:65:import_set_state_nolock()) ffff89f1ae71a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788940335.502810:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b500d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2349:x1875839718262784:12345-192.168.202.14@tcp:38: Request processed in 41789us (42020us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940335.502822:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 4 00010000:00010000:1.0:1788940335.789917:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940336.517750:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940336.517844:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940336.531487:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718263040 00000100:00100000:1.0:1788940336.531834:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718263040 00000100:00100000:1.0:1788940336.531953:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718262912 00000100:00100000:1.0:1788940336.531957:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718262912 00000100:00100000:1.0:1788940336.531987:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 5 00000100:00100000:1.0:1788940336.531998:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b500e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+7:5584:x1875839718263040:12345-192.168.202.14@tcp:41: 00000004:00000024:1.0:1788940336.532047:0:5861:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1788940336.532127:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b500e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+7:5584:x1875839718263040:12345-192.168.202.14@tcp:41: Request processed in 130us (14385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940336.532144:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 5 00000100:00100000:1.0:1788940336.532164:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 6 00000100:00100000:1.0:1788940336.532171:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b500c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:0:x1875839718262912:12345-192.168.202.14@tcp:41: 00000004:00000024:1.0:1788940336.532183:0:5861:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1788940336.532204:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b500c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:0:x1875839718262912:12345-192.168.202.14@tcp:41: Request processed in 34us (14360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940336.532210:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 6 00000100:00080000:0.0:1788940336.532384:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788940336.542776:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940336.543187:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718263168 00000100:00100000:1.0:1788940336.543200:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718263168 00000100:00100000:1.0:1788940336.543283:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 7 00000100:00100000:1.0:1788940336.543296:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b500df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:5584:x1875839718263168:12345-192.168.202.14@tcp:40: 00000100:00100000:1.0:1788940336.543394:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b500df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:5584:x1875839718263168:12345-192.168.202.14@tcp:40: Request processed in 100us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940336.543402:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 7 00000100:00100000:3.0:1788940336.549017:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940336.549066:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940336.549333:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718263680 00000100:00100000:2.0:1788940336.549352:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718263680 00000100:00100000:2.0:1788940336.549430:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 130 00000100:00100000:2.0:1788940336.549442:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f188d36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0b05a86-29c8-44a6-9c64-75d9d650043e+10:2352:x1875839718263680:12345-192.168.202.14@tcp:400: 00000100:00100000:2.0:1788940336.549644:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f188d36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0b05a86-29c8-44a6-9c64-75d9d650043e+10:2352:x1875839718263680:12345-192.168.202.14@tcp:400: Request processed in 203us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940336.549652:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 130 00000100:00100000:1.0:1788940336.549768:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718263296 00000100:00100000:1.0:1788940336.549774:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718263296 00000100:00100000:1.0:1788940336.549802:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 8 00000100:00100000:1.0:1788940336.549807:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b500d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2349:x1875839718263296:12345-192.168.202.14@tcp:8: 00010000:00080000:1.0:1788940336.549850:0:6705:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 9c51ff78-d02d-4e61-8a10-a2f8830f1679@192.168.202.14@tcp t0 exp 0000000000000000 cur 279 last 0 00000020:00000080:1.0:1788940336.549888:0:6705:0:(genops.c:1393:class_connect()) connect: client 9c51ff78-d02d-4e61-8a10-a2f8830f1679, cookie 0x27a633fcdd4aa9a 00002000:00100000:1.0:1788940336.549900:0:6705:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 9c51ff78-d02d-4e61-8a10-a2f8830f1679/ffff89f0841e1000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788940336.549925:0:6705:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788940336.553053:0:6705:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788940336.553097:0:6705:0:(import.c:65:import_set_state_nolock()) ffff89f0841e6800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788940336.554497:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b500d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2349:x1875839718263296:12345-192.168.202.14@tcp:8: Request processed in 4680us (5421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940336.554821:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 8 00000100:00100000:0.0:1788940336.562250:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940336.562428:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940336.562706:0:7074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718263424 00000100:00100000:3.0:1788940336.562726:0:7074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718263424 00000100:00100000:3.0:1788940336.562801:0:7074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 9 00000100:00100000:3.0:1788940336.562812:0:7074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f0821c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2349:x1875839718263424:12345-192.168.202.14@tcp:8: 00010000:00080000:3.0:1788940336.562853:0:7074:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 9c51ff78-d02d-4e61-8a10-a2f8830f1679@192.168.202.14@tcp t0 exp 0000000000000000 cur 279 last 0 00000020:00000080:3.0:1788940336.562938:0:7074:0:(genops.c:1393:class_connect()) connect: client 9c51ff78-d02d-4e61-8a10-a2f8830f1679, cookie 0x27a633fcdd4aaa1 00002000:00100000:3.0:1788940336.562956:0:7074:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9c51ff78-d02d-4e61-8a10-a2f8830f1679/ffff89f1b4d03800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788940336.562989:0:7074:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788940336.567469:0:7074:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788940336.567543:0:7074:0:(import.c:65:import_set_state_nolock()) ffff89f1b4d05800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788940336.567648:0:7074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f0821c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2349:x1875839718263424:12345-192.168.202.14@tcp:8: Request processed in 4835us (5404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940336.567661:0:7074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 9 00000100:00100000:2.0:1788940336.570020:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718263552 00000100:00100000:2.0:1788940336.570038:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718263552 00000100:00100000:2.0:1788940336.570133:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 0 00000100:00100000:2.0:1788940336.570144:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f0821c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:5584:x1875839718263552:12345-192.168.202.14@tcp:33: 00000004:00080000:2.0:1788940336.619228:0:5863:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 48993us 00000004:00200000:2.0:1788940336.691255:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788940336.691438:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f0821c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:5584:x1875839718263552:12345-192.168.202.14@tcp:33: Request processed in 121286us (129001us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940336.691451:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 0 00010000:00010000:0.0:1788940336.812798:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940336.987490:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940336.987919:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718263808 00000100:00100000:3.0:1788940336.987933:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718263808 00000100:00100000:3.0:1788940336.988020:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 8 00000100:00100000:3.0:1788940336.988032:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:5625:x1875839718263808:12345-192.168.202.14@tcp:101: 00010000:00010000:3.0:1788940336.988077:0:7857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940336.988111:0:7857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829da200/0x27a633fcdd4aaa8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f56a1 expref: -99 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940336.988198:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829da800/0x27a633fcdd4aaaf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940336.988215:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829da800/0x27a633fcdd4aaaf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940336.988235:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829da800/0x27a633fcdd4aaaf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940336.988293:0:7857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788940336.988297:0:7857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788940336.988320:0:7857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829da800/0x27a633fcdd4aaaf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940336.988350:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829da200/0x27a633fcdd4aaa8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f56a1 expref: 8 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940336.988371:0:7857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829da800/0x27a633fcdd4aaaf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f56a1 expref: 7 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940336.988380:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f18a6cec00) 00010000:00010000:3.0:1788940336.988383:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788940336.988388:0:7857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f1829da800, rc 0) 00000100:00100000:3.0:1788940336.988472:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+7:5625:x1875839718263808:12345-192.168.202.14@tcp:101: Request processed in 442us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940336.988480:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 8 00010000:00010000:2.0:1788940337.838201:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940338.669509:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788940338.669571:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738209024:0@lo:13: 00000100:00100000:0.0:1788940338.669668:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940338.669824:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738209024 00000100:00100000:2.0:1788940338.669835:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738209024 00000100:00100000:2.0:1788940338.669937:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788940338.669947:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f0821c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738209024:12345-0@lo:13: 00002000:00000024:2.0:1788940338.671481:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788940338.672089:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f0821c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738209024:12345-0@lo:13: Request processed in 2137us (2414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940338.672102:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1788940338.672220:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1b5c6fb80 x1875839738209024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940354 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940338.672247:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738209024:0@lo:13: 00000100:00080000:1.0:1788940338.678336:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788940338.860955:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940339.128262:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940339.128927:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718263936 00000100:00100000:3.0:1788940339.128943:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718263936 00000100:00100000:3.0:1788940339.129181:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 9 00000100:00100000:3.0:1788940339.129195:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+7:5677:x1875839718263936:12345-192.168.202.14@tcp:41: 00000004:00000024:3.0:1788940339.129257:0:5861:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00080000:1.0:1788940339.129551:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788940339.129663:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+7:5677:x1875839718263936:12345-192.168.202.14@tcp:41: Request processed in 471us (1416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940339.129672:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 9 00000100:00100000:0.0:1788940339.136387:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940339.136790:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718264064 00000100:00100000:2.0:1788940339.136803:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718264064 00000100:00080000:1.0:1788940339.136965:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788940339.137014:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 9 00000100:00100000:2.0:1788940339.137027:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f0821c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:5677:x1875839718264064:12345-192.168.202.14@tcp:13: 00002000:00000024:2.0:1788940339.137059:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788940339.137138:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f0821c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:5677:x1875839718264064:12345-192.168.202.14@tcp:13: Request processed in 115us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940339.137146:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 9 00000100:00100000:1.0:1788940339.139732:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940339.140953:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718264192 00000100:00100000:2.0:1788940339.140971:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718264192 00000100:00100000:2.0:1788940339.141141:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 10 00000100:00100000:2.0:1788940339.141154:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4cd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:5677:x1875839718264192:12345-192.168.202.14@tcp:13: 00002000:00000024:2.0:1788940339.141205:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788940339.141287:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4cd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:5677:x1875839718264192:12345-192.168.202.14@tcp:13: Request processed in 135us (1567us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940339.141297:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 10 00000100:00080000:1.0:1788940339.143171:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:2.0:1788940339.289043:0:6732:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9c51ff78-d02d-4e61-8a10-a2f8830f1679 00000100:00100000:3.0:1788940339.695184:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3306:1875839738209152:0@lo:400: 00000100:00100000:2.0:1788940339.695221:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738209536:0@lo:400: 00000100:00100000:2.0:1788940339.695286:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940339.695288:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940339.695409:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875839738209280:0@lo:400: 00000100:00100000:3.0:1788940339.695566:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875839738209664:0@lo:400: 00000100:00100000:3.0:1788940339.695600:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940339.695654:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738209152 00000100:00100000:0.0:1788940339.695654:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738209664 00000100:00100000:0.0:1788940339.695665:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738209664 00000100:00100000:3.0:1788940339.695666:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738209152 00000100:00100000:0.0:1788940339.695735:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788940339.695747:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b500c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875839738209664:12345-0@lo:400: 00000100:00100000:3.0:1788940339.695782:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788940339.695792:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1980ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3306:x1875839738209152:12345-0@lo:400: 00000100:00100000:0.0:1788940339.695818:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b500c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875839738209664:12345-0@lo:400: Request processed in 71us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940339.695826:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788940339.695838:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1980ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3306:x1875839738209152:12345-0@lo:400: Request processed in 47us (552us total) trans 0 rc 0/0 00000100:00080000:0.0:1788940339.695868:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788940339.695908:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875839738209664:0@lo:400: 00000100:00100000:3.0:1788940339.695935:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788940339.696060:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3306:1875839738209152:0@lo:400: 00000100:00100000:2.0:1788940339.696898:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875839738209408:0@lo:400: 00000100:00100000:2.0:1788940339.696976:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940339.697146:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788940339.697156:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738209792:0@lo:400: 00000100:00100000:1.0:1788940339.697168:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738209408 00000100:00100000:1.0:1788940339.697177:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738209408 00000100:00100000:2.0:1788940339.697188:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940339.697223:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738209536 00000100:00100000:2.0:1788940339.697227:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738209536 00000100:00100000:2.0:1788940339.697262:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738209792 00000100:00100000:2.0:1788940339.697265:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738209792 00000100:00100000:2.0:1788940339.697289:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788940339.697296:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738209536:12345-0@lo:400: 00000100:00100000:1.0:1788940339.697350:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788940339.697351:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738209536:12345-0@lo:400: Request processed in 50us (2063us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940339.697361:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788940339.697366:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875839738209408:12345-0@lo:400: 00000100:00100000:2.0:1788940339.697379:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788940339.697387:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738209792:12345-0@lo:400: 00000100:00100000:1.0:1788940339.697422:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875839738209408:12345-0@lo:400: Request processed in 60us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940339.697428:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738209792:12345-0@lo:400: Request processed in 41us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940339.697433:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788940339.697445:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1788940339.697483:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f0821c1500 x1875839738209792/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1788940339.697501:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f0821c0380 x1875839738209536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940339.697508:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738209792:0@lo:400: 00000100:00100000:2.0:1788940339.697539:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738209536:0@lo:400: 00000100:00100000:1.0:1788940339.697652:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875839738209408:0@lo:400: 00000100:00080000:1.0:1788940339.697677:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788940339.697682:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940339.697693:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940339.697738:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738209280 00000100:00100000:2.0:1788940339.697743:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738209280 00000100:00100000:2.0:1788940339.698147:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788940339.698158:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875839738209280:12345-0@lo:400: 00000100:00100000:2.0:1788940339.698208:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875839738209280:12345-0@lo:400: Request processed in 53us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940339.698215:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788940339.698247:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875839738209280:0@lo:400: 00010000:00010000:3.0:1788940339.890891:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940340.204720:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738209920:0@lo:13: 00000100:00100000:1.0:1788940340.204795:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940340.204921:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738209920 00000100:00100000:0.0:1788940340.204939:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738209920 00000100:00100000:0.0:1788940340.205010:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788940340.205020:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4cd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738209920:12345-0@lo:13: 00002000:00000024:0.0:1788940340.205046:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788940340.205099:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4cd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738209920:12345-0@lo:13: Request processed in 81us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940340.205105:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1788940340.205186:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f0821c2300 x1875839738209920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940356 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940340.205204:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738209920:0@lo:13: 00000001:00100000:0.0:1788940340.792125:0:5883:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9c51ff78-d02d-4e61-8a10-a2f8830f1679 00000001:00100000:2.0:1788940340.851956:0:7662:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9c51ff78-d02d-4e61-8a10-a2f8830f1679 00010000:00010000:1.0:1788940340.909619:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940341.762139:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940341.762179:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940341.762216:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940341.762248:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718264576 00000100:00100000:1.0:1788940341.762270:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718264576 00000100:00100000:1.0:1788940341.762337:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 9 00000100:00100000:1.0:1788940341.762349:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4cd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+5:2350:x1875839718264576:12345-192.168.202.14@tcp:400: 00000100:00100000:1.0:1788940341.762420:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4cd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+5:2350:x1875839718264576:12345-192.168.202.14@tcp:400: Request processed in 74us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940341.762428:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 9 00000100:00080000:1.0:1788940341.762465:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788940341.762814:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718264448 00000100:00100000:2.0:1788940341.762819:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718264448 00000100:00100000:2.0:1788940341.762873:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 27 00000100:00100000:2.0:1788940341.762882:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4cd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2350:x1875839718264448:12345-192.168.202.14@tcp:400: 00000100:00100000:2.0:1788940341.762918:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4cd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2350:x1875839718264448:12345-192.168.202.14@tcp:400: Request processed in 38us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940341.762924:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 27 00000100:00080000:1.0:1788940341.763010:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788940341.763222:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718264320 00000100:00100000:3.0:1788940341.763226:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718264320 00000100:00100000:1.0:1788940341.763492:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940341.763706:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 132 00000100:00100000:3.0:1788940341.763715:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1980dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+10:2350:x1875839718264320:12345-192.168.202.14@tcp:400: 00000100:00100000:3.0:1788940341.763752:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1980dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+10:2350:x1875839718264320:12345-192.168.202.14@tcp:400: Request processed in 38us (1622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940341.763770:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 132 00000100:00100000:2.0:1788940341.770634:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718264704 00000100:00100000:2.0:1788940341.770654:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718264704 00000100:00100000:2.0:1788940341.770759:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 10 00000100:00100000:2.0:1788940341.770773:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4cd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+5:2350:x1875839718264704:12345-192.168.202.14@tcp:400: 00000100:00100000:2.0:1788940341.770868:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4cd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+5:2350:x1875839718264704:12345-192.168.202.14@tcp:400: Request processed in 99us (7376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940341.770894:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 10 00000100:00080000:0.0:1788940341.771056:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788940341.937735:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788940342.355059:0:8316:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788940342.957382:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940343.789023:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738210048:0@lo:13: 00000100:00100000:3.0:1788940343.789101:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940343.789245:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738210048 00000100:00100000:2.0:1788940343.789254:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738210048 00000100:00100000:2.0:1788940343.789329:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788940343.789341:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b500d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738210048:12345-0@lo:13: 00002000:00000024:2.0:1788940343.789379:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788940343.789424:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b500d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738210048:12345-0@lo:13: Request processed in 85us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940343.789430:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1788940343.789465:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1b5c6df80 x1875839738210048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940359 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940343.789483:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738210048:0@lo:13: 00000100:00080000:0.0:1788940343.789546:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788940343.983259:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940344.813135:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738210560:0@lo:400: 00000100:00100000:2.0:1788940344.813243:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940344.813333:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788940344.813339:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3305:1875839738210176:0@lo:400: 00000100:00100000:2.0:1788940344.813371:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940344.813396:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875839738210688:0@lo:400: 00000100:00100000:2.0:1788940344.813422:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940344.813457:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738210176 00000100:00100000:2.0:1788940344.813465:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738210176 00000100:00100000:2.0:1788940344.813544:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788940344.813555:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1980de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3305:x1875839738210176:12345-0@lo:400: 00000100:00100000:2.0:1788940344.813614:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1980de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3305:x1875839738210176:12345-0@lo:400: Request processed in 60us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940344.813636:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788940344.813668:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738210688 00000100:00100000:2.0:1788940344.813672:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738210688 00000100:00100000:2.0:1788940344.813710:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788940344.813717:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875839738210688:12345-0@lo:400: 00000100:00100000:2.0:1788940344.813749:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875839738210688:12345-0@lo:400: Request processed in 32us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940344.813755:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788940344.813806:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3305:1875839738210176:0@lo:400: 00000100:00100000:2.0:1788940344.813822:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875839738210688:0@lo:400: 00000100:00100000:0.0:1788940344.813943:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738210560 00000100:00100000:0.0:1788940344.813948:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738210560 00000100:00100000:0.0:1788940344.813985:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788940344.813992:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738210560:12345-0@lo:400: 00000100:00100000:0.0:1788940344.814042:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738210560:12345-0@lo:400: Request processed in 50us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940344.814047:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1788940344.814066:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788940344.814129:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f0821c1f80 x1875839738210560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940344.814140:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738210560:0@lo:400: 00000100:00100000:1.0:1788940344.814210:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875839738210304:0@lo:400: 00000100:00100000:1.0:1788940344.814242:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940344.814272:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738210816:0@lo:400: 00000100:00100000:1.0:1788940344.814294:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940344.814318:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788940344.814324:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875839738210432:0@lo:400: 00000100:00100000:1.0:1788940344.814345:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940344.814378:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738210304 00000100:00100000:1.0:1788940344.814382:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738210304 00000100:00100000:1.0:1788940344.814408:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738210432 00000100:00100000:1.0:1788940344.814411:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738210432 00000100:00100000:1.0:1788940344.814435:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788940344.814441:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875839738210304:12345-0@lo:400: 00000100:00100000:1.0:1788940344.814479:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875839738210304:12345-0@lo:400: Request processed in 38us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940344.814485:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788940344.814498:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788940344.814504:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4cd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875839738210432:12345-0@lo:400: 00000100:00100000:1.0:1788940344.814571:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4cd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875839738210432:12345-0@lo:400: Request processed in 67us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940344.814577:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788940344.814608:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875839738210432:0@lo:400: 00000100:00100000:1.0:1788940344.814618:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875839738210304:0@lo:400: 00000100:00100000:0.0:1788940344.814742:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738210816 00000100:00100000:0.0:1788940344.814746:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738210816 00000100:00100000:0.0:1788940344.814787:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788940344.814805:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4cd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738210816:12345-0@lo:400: 00000100:00100000:0.0:1788940344.814855:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4cd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738210816:12345-0@lo:400: Request processed in 61us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940344.814862:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1788940344.814879:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788940344.814884:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788940344.815172:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f0821c2300 x1875839738210816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940344.815196:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738210816:0@lo:400: 00010000:00010000:3.0:1788940345.004785:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940345.337124:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788940345.337162:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738210944:0@lo:13: 00000100:00100000:3.0:1788940345.337257:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940345.337713:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738210944 00000100:00100000:0.0:1788940345.337731:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738210944 00000100:00100000:0.0:1788940345.337802:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788940345.337814:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b500ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738210944:12345-0@lo:13: 00002000:00000024:0.0:1788940345.337860:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788940345.337922:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b500ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738210944:12345-0@lo:13: Request processed in 110us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940345.337929:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1788940345.338031:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f0821c0e00 x1875839738210944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940361 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940345.338054:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738210944:0@lo:13: 00010000:00010000:3.0:1788940346.028721:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788940346.447718:0:8464:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc9688e8f0 20000000:00000080:0.0:1788940346.447736:0:8464:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff89f18de74000 uarg=0000000000000000 20000000:01000000:0.0:1788940346.447771:0:8464:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1788940346.447773:0:8464:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1788940346.447776:0:8464:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1788940346.447790:0:8464:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1788940346.447795:0:8464:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1788940346.447809:0:8464:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788940346.447812:0:8464:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788940346.447993:0:8464:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1788940346.447996:0:8464:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788940346.449294:0:8465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1788940346.450117:0:8464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1788940346.450282:0:8464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:0.0:1788940346.450323:0:8464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:0.0:1788940346.450337:0:8464:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788940346.450340:0:8464:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788940346.451329:0:8466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:0.0:1788940346.451964:0:8464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:0.0:1788940346.452018:0:8464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:0.0:1788940346.452052:0:8464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:0.0:1788940346.452065:0:8464:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788940346.452067:0:8464:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788940346.453083:0:8467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:0.0:1788940346.453948:0:8464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:0.0:1788940346.454001:0:8464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:0.0:1788940346.454057:0:8464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:0.0:1788940346.454080:0:8464:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788940346.454083:0:8464:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788940346.455317:0:8468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:0.0:1788940346.455925:0:8464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:0.0:1788940346.455990:0:8464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:0.0:1788940346.456029:0:8464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:0.0:1788940346.456045:0:8464:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788940346.456066:0:8464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89f082ad2a00/0x27a633fcdd4aab6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940346.456084:0:8464:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89f1c21f1e00/0x27a633fcdd4a9b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4a9ac expref: 18 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940346.456093:0:8464:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89f082ad2000/0x27a633fcdd4a9dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4a9d6 expref: 18 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940346.456100:0:8464:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89f181520000/0x27a633fcdd4aa07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4aa00 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940346.456106:0:8464:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89f082ad3600/0x27a633fcdd4aa15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4aa0e expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940346.456113:0:8464:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89f181521e00/0x27a633fcdd4aa23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4aa1c expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940346.456119:0:8464:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89f082ad2400/0x27a633fcdd4aa3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4aa38 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940346.456125:0:8464:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89f082ad2200/0x27a633fcdd4aa69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4aa62 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940346.456302:0:8464:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89f082ad3000/0x27a633fcdd4aa77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f563f expref: 9 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940346.456323:0:8464:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89f1c21f1000/0x27a633fcdd4aa7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5646 expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940346.456331:0:8464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89f082ad2a00/0x27a633fcdd4aab6 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940346.456374:0:8464:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89f1c21f1000/0x27a633fcdd4aa7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5646 expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940346.456392:0:8464:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89f1c21f1000/0x27a633fcdd4aa7e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5646 expref: 9 pid: 5854 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940346.456408:0:8464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8464:1875839738211072:192.168.202.14@tcp:104: 00010000:00010000:0.0:1788940346.456965:0:8464:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89f082ad3000/0x27a633fcdd4aa77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f563f expref: 9 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940346.456975:0:8464:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89f082ad3000/0x27a633fcdd4aa77 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f563f expref: 9 pid: 5853 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940346.456984:0:8464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8464:1875839738211200:192.168.202.14@tcp:104: 00010000:00010000:0.0:1788940346.457018:0:8464:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89f082ad2200/0x27a633fcdd4aa69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27a633fcdd4aa62 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940346.457026:0:8464:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89f082ad2200/0x27a633fcdd4aa69 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27a633fcdd4aa62 expref: 18 pid: 5853 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940346.457036:0:8464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8464:1875839738211328:0@lo:104: 00000100:00100000:0.0:1788940346.457074:0:8464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788940346.457312:0:8464:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89f082ad2400/0x27a633fcdd4aa3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27a633fcdd4aa38 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940346.457321:0:8464:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89f082ad2400/0x27a633fcdd4aa3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27a633fcdd4aa38 expref: 18 pid: 5853 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940346.457329:0:8464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8464:1875839738211456:0@lo:104: 00000100:00100000:0.0:1788940346.457354:0:8464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788940346.458049:0:8464:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89f181521e00/0x27a633fcdd4aa23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27a633fcdd4aa1c expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940346.458060:0:8464:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89f181521e00/0x27a633fcdd4aa23 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27a633fcdd4aa1c expref: 18 pid: 5855 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940346.458069:0:8464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8464:1875839738211584:0@lo:104: 00010000:00010000:0.0:1788940346.458101:0:8464:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89f082ad3600/0x27a633fcdd4aa15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27a633fcdd4aa0e expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940346.458108:0:8464:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89f082ad3600/0x27a633fcdd4aa15 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27a633fcdd4aa0e expref: 18 pid: 5855 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940346.458115:0:8464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8464:1875839738211712:0@lo:104: 00010000:00010000:0.0:1788940346.458147:0:8464:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89f181520000/0x27a633fcdd4aa07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27a633fcdd4aa00 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940346.458553:0:8464:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89f181520000/0x27a633fcdd4aa07 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27a633fcdd4aa00 expref: 18 pid: 5853 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940346.458562:0:8464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8464:1875839738211840:0@lo:104: 00010000:00010000:0.0:1788940346.458594:0:8464:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89f082ad2000/0x27a633fcdd4a9dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27a633fcdd4a9d6 expref: 18 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940346.458615:0:8464:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89f082ad2000/0x27a633fcdd4a9dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27a633fcdd4a9d6 expref: 18 pid: 5854 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940346.458624:0:8464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8464:1875839738211968:0@lo:104: 00010000:00010000:0.0:1788940346.458654:0:8464:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89f1c21f1e00/0x27a633fcdd4a9b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27a633fcdd4a9ac expref: 18 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940346.458662:0:8464:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89f1c21f1e00/0x27a633fcdd4a9b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27a633fcdd4a9ac expref: 18 pid: 5854 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940346.458669:0:8464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8464:1875839738212096:0@lo:104: 00000100:00100000:0.0:1788940346.458687:0:8464:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1baa6a540 going to sleep for 11 seconds 00000100:00100000:3.0:1788940346.458894:0:5844:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788940346.458919:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940346.459066:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940346.459086:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738211328 00000100:00100000:2.0:1788940346.459094:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738211328 00000100:00100000:2.0:1788940346.459151:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738211456 00000100:00100000:2.0:1788940346.459276:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738211456 00000100:00100000:2.0:1788940346.459293:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738211584 00000100:00100000:2.0:1788940346.459296:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738211584 00000100:00100000:2.0:1788940346.459308:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788940346.459317:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f0821c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+5:8464:x1875839738211328:12345-0@lo:104: 00010000:00010000:2.0:1788940346.459331:0:5843:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff89f082ad2800/0x27a633fcdd4aa62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4aa69 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940346.459469:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788940346.459476:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f0821c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+5:8464:x1875839738211328:12345-0@lo:104: Request processed in 160us (2401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940346.459493:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788940346.459511:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788940346.459655:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1841d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+4:8464:x1875839738211456:12345-0@lo:104: 00010000:00010000:2.0:1788940346.459664:0:5843:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff89f082ad2c00/0x27a633fcdd4aa38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4aa3f expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940346.459768:0:8464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8464:1875839738211328:0@lo:104: 00000100:00100000:0.0:1788940346.459786:0:8464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8464:1875839738211456:0@lo:104: 00000100:00100000:3.0:1788940346.459857:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940346.459867:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940346.459876:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940346.459884:0:5844:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1788940346.459891:0:5844:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:1.0:1788940346.460068:0:7650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788940346.460076:0:7650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff89f082ad2800/0x27a633fcdd4aa62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4aa69 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940346.460084:0:7650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad2800 already unused, calling callback (ffffffffc1d10c20) 10000000:00010000:1.0:1788940346.460088:0:7650:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff89f082ad2800/0x27a633fcdd4aa62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x27a633fcdd4aa69 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940346.460096:0:7650:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff89f082ad2800/0x27a633fcdd4aa62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x27a633fcdd4aa69 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788940346.460103:0:7650:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff89f082ad2800/0x27a633fcdd4aa62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x27a633fcdd4aa69 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940346.460109:0:7650:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788940346.460312:0:7650:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff89f082ad2800/0x27a633fcdd4aa62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4aa69 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940346.460319:0:7650:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788940346.460347:0:7650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff89f082ad2800/0x27a633fcdd4aa62 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4aa69 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940346.460354:0:7650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff89f082ad2800/0x27a633fcdd4aa62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4aa69 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940346.460368:0:7650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940346.460371:0:7650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff89f082ad2c00/0x27a633fcdd4aa38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4aa3f expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940346.460389:0:7650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad2c00 already unused, calling callback (ffffffffc1d10c20) 10000000:00010000:1.0:1788940346.460392:0:7650:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff89f082ad2c00/0x27a633fcdd4aa38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x27a633fcdd4aa3f expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940346.460398:0:7650:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff89f082ad2c00/0x27a633fcdd4aa38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x27a633fcdd4aa3f expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788940346.460403:0:7650:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff89f082ad2c00/0x27a633fcdd4aa38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x27a633fcdd4aa3f expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940346.460408:0:7650:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788940346.460424:0:7650:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff89f082ad2c00/0x27a633fcdd4aa38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4aa3f expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940346.460429:0:7650:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788940346.460435:0:7650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff89f082ad2c00/0x27a633fcdd4aa38 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4aa3f expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940346.460442:0:7650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff89f082ad2c00/0x27a633fcdd4aa38 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4aa3f expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940346.460557:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4f66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3305:1875839738212224:0@lo:103: 00000100:00100000:0.0:1788940346.460598:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940346.460633:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788940346.460638:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4f67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3305:1875839738212352:0@lo:103: 00000100:00100000:0.0:1788940346.460658:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940346.460683:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738212224 00000100:00100000:0.0:1788940346.460688:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738212224 00010000:00010000:0.0:1788940346.460711:0:5845:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89f082ad2200/0x27a633fcdd4aa69 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4aa62 expref: 19 pid: 5853 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940346.460736:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738212352 00000100:00100000:0.0:1788940346.460739:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738212352 00010000:00010000:0.0:1788940346.460749:0:5845:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89f082ad2400/0x27a633fcdd4aa3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4aa38 expref: 20 pid: 5853 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940346.460771:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788940346.460791:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f0821c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+20:3305:x1875839738212224:12345-0@lo:103: 00010000:00010000:0.0:1788940346.460803:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940346.460808:0:5845:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89f082ad2200/0x27a633fcdd4aa69 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4aa62 expref: 20 pid: 5853 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940346.460816:0:5845:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89f082ad2200/0x27a633fcdd4aa69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27a633fcdd4aa62 expref: 20 pid: 5853 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940346.460829:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f082ad2200/0x27a633fcdd4aa69 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27a633fcdd4aa62 expref: 20 pid: 5853 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940346.460841:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940346.460873:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f0821c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3305:x1875839738212224:12345-0@lo:103: Request processed in 96us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940346.460879:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788940346.460895:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788940346.460901:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f0821c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+18:3305:x1875839738212352:12345-0@lo:103: 00010000:00010000:0.0:1788940346.460908:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940346.460912:0:5845:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89f082ad2400/0x27a633fcdd4aa3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4aa38 expref: 18 pid: 5853 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940346.460920:0:5845:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89f082ad2400/0x27a633fcdd4aa3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27a633fcdd4aa38 expref: 18 pid: 5853 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940346.460930:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f082ad2400/0x27a633fcdd4aa3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27a633fcdd4aa38 expref: 18 pid: 5853 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940346.460947:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940346.460970:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f0821c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+17:3305:x1875839738212352:12345-0@lo:103: Request processed in 70us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940346.460976:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788940346.461013:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4f67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3305:1875839738212352:0@lo:103: 00000100:00100000:0.0:1788940346.461020:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4f66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3305:1875839738212224:0@lo:103: 00010000:00010000:1.0:1788940346.461283:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940346.461285:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940346.461287:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940346.461459:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738211712 00000100:00100000:0.0:1788940346.461464:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738211712 00000100:00100000:0.0:1788940346.461488:0:5844:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1788940346.461493:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738211840 00000100:00100000:0.0:1788940346.461496:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738211840 00000100:00100000:0.0:1788940346.461504:0:5844:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1788940346.461508:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738211968 00000100:00100000:0.0:1788940346.461511:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738211968 00000100:00100000:0.0:1788940346.461554:0:5844:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1788940346.461560:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738212096 00000100:00100000:0.0:1788940346.461562:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738212096 00010000:00010000:2.0:1788940346.461789:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1788940346.461799:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1841d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+8:8464:x1875839738211456:12345-0@lo:104: Request processed in 2281us (4442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940346.461806:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788940346.461846:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788940346.461856:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b500e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+7:8464:x1875839738211584:12345-0@lo:104: 00010000:00010000:2.0:1788940346.461868:0:5843:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff89f1c21f0e00/0x27a633fcdd4aa1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4aa23 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940346.461929:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788940346.461935:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b500e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+7:8464:x1875839738211584:12345-0@lo:104: Request processed in 82us (3016us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940346.461941:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788940346.461954:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788940346.461960:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b500fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+6:8464:x1875839738211712:12345-0@lo:104: 00010000:00010000:2.0:1788940346.461968:0:5843:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff89f181520e00/0x27a633fcdd4aa0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4aa15 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940346.462001:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788940346.462006:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b500fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+6:8464:x1875839738211712:12345-0@lo:104: Request processed in 47us (2940us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940346.462022:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788940346.462036:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788940346.462043:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b48a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+5:8464:x1875839738211840:12345-0@lo:104: 00010000:00010000:2.0:1788940346.462050:0:5843:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff89f082ad3400/0x27a633fcdd4aa00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4aa07 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940346.462088:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788940346.462093:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b48a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+5:8464:x1875839738211840:12345-0@lo:104: Request processed in 52us (2236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940346.462098:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788940346.462111:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788940346.462118:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b48a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+4:8464:x1875839738211968:12345-0@lo:104: 00010000:00010000:2.0:1788940346.462125:0:5843:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff89f1829db400/0x27a633fcdd4a9d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4a9dd expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940346.462297:0:7649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788940346.462305:0:7649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff89f1c21f0e00/0x27a633fcdd4aa1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4aa23 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940346.462312:0:7649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1c21f0e00 already unused, calling callback (ffffffffc1d10c20) 10000000:00010000:1.0:1788940346.462323:0:7649:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff89f1c21f0e00/0x27a633fcdd4aa1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x27a633fcdd4aa23 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940346.462332:0:7649:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff89f1c21f0e00/0x27a633fcdd4aa1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x27a633fcdd4aa23 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788940346.462339:0:7649:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff89f1c21f0e00/0x27a633fcdd4aa1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x27a633fcdd4aa23 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940346.462345:0:7649:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788940346.462375:0:7649:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff89f1c21f0e00/0x27a633fcdd4aa1c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4aa23 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940346.462381:0:7649:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788940346.462400:0:7649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff89f1c21f0e00/0x27a633fcdd4aa1c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4aa23 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940346.462407:0:7649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff89f1c21f0e00/0x27a633fcdd4aa1c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4aa23 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940346.462418:0:7649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788940346.462421:0:7649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff89f181520e00/0x27a633fcdd4aa0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4aa15 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940346.462426:0:7649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f181520e00 already unused, calling callback (ffffffffc1d10c20) 10000000:00010000:1.0:1788940346.462429:0:7649:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff89f181520e00/0x27a633fcdd4aa0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x27a633fcdd4aa15 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940346.462436:0:7649:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff89f181520e00/0x27a633fcdd4aa0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x27a633fcdd4aa15 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788940346.462441:0:7649:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff89f181520e00/0x27a633fcdd4aa0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x27a633fcdd4aa15 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940346.462466:0:7649:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788940346.462480:0:7649:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff89f181520e00/0x27a633fcdd4aa0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4aa15 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940346.462486:0:7649:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788940346.462492:0:7649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff89f181520e00/0x27a633fcdd4aa0e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4aa15 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940346.462498:0:7649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff89f181520e00/0x27a633fcdd4aa0e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4aa15 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940346.462507:0:7649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940346.462510:0:7649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff89f082ad3400/0x27a633fcdd4aa00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4aa07 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940346.462515:0:7649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad3400 already unused, calling callback (ffffffffc1d10c20) 10000000:00010000:1.0:1788940346.462547:0:7649:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff89f082ad3400/0x27a633fcdd4aa00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x27a633fcdd4aa07 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940346.462554:0:7649:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff89f082ad3400/0x27a633fcdd4aa00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x27a633fcdd4aa07 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788940346.462560:0:7649:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff89f082ad3400/0x27a633fcdd4aa00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x27a633fcdd4aa07 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940346.462564:0:7649:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788940346.462575:0:7649:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff89f082ad3400/0x27a633fcdd4aa00 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4aa07 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940346.462581:0:7649:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788940346.462600:0:7649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff89f082ad3400/0x27a633fcdd4aa00 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4aa07 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940346.462607:0:7649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff89f082ad3400/0x27a633fcdd4aa00 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4aa07 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940346.462616:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940346.462618:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940346.462619:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940346.462626:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940346.462638:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4f66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3307:1875839738212480:0@lo:103: 00000100:00100000:1.0:1788940346.462675:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940346.462711:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788940346.462717:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4f64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3307:1875839738212608:0@lo:103: 00000100:00100000:1.0:1788940346.462738:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940346.462763:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788940346.462770:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4f64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3306:1875839738212736:0@lo:103: 00000100:00100000:1.0:1788940346.462820:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940346.462847:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738212480 00000100:00100000:1.0:1788940346.462852:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738212480 00010000:00010000:1.0:1788940346.462873:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89f181521e00/0x27a633fcdd4aa23 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4aa1c expref: 17 pid: 5855 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940346.462889:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738212608 00000100:00100000:1.0:1788940346.462891:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738212608 00010000:00010000:1.0:1788940346.462900:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89f082ad3600/0x27a633fcdd4aa15 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4aa0e expref: 18 pid: 5855 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940346.462908:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738212736 00000100:00100000:1.0:1788940346.462910:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738212736 00010000:00010000:1.0:1788940346.462918:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89f181520000/0x27a633fcdd4aa07 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4aa00 expref: 19 pid: 5853 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940346.462937:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788940346.462942:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3307:x1875839738212480:12345-0@lo:103: 00010000:00010000:1.0:1788940346.462952:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940346.462956:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89f181521e00/0x27a633fcdd4aa23 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4aa1c expref: 19 pid: 5855 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940346.462965:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89f181521e00/0x27a633fcdd4aa23 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27a633fcdd4aa1c expref: 19 pid: 5855 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940346.462979:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940346.463007:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3307:x1875839738212480:12345-0@lo:103: Request processed in 65us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940346.463012:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788940346.463027:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788940346.463032:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f67100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+18:3307:x1875839738212608:12345-0@lo:103: 00010000:00010000:1.0:1788940346.463039:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940346.463043:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89f082ad3600/0x27a633fcdd4aa15 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4aa0e expref: 18 pid: 5855 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940346.463051:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89f082ad3600/0x27a633fcdd4aa15 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27a633fcdd4aa0e expref: 18 pid: 5855 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940346.463059:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940346.463079:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f67100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+18:3307:x1875839738212608:12345-0@lo:103: Request processed in 48us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940346.463084:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788940346.463095:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788940346.463107:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf555500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+17:3306:x1875839738212736:12345-0@lo:103: 00010000:00010000:1.0:1788940346.463115:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940346.463119:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89f181520000/0x27a633fcdd4aa07 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4aa00 expref: 17 pid: 5853 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940346.463127:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89f181520000/0x27a633fcdd4aa07 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27a633fcdd4aa00 expref: 17 pid: 5853 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940346.463149:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940346.463429:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf555500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+17:3306:x1875839738212736:12345-0@lo:103: Request processed in 322us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940346.463436:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788940346.463709:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4f64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3306:1875839738212736:0@lo:103: 00000100:00100000:1.0:1788940346.463739:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4f64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3307:1875839738212608:0@lo:103: 00000100:00100000:1.0:1788940346.463746:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4f66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3307:1875839738212480:0@lo:103: 00010000:00010000:2.0:1788940346.463881:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788940346.463887:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b48a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+4:8464:x1875839738211968:12345-0@lo:104: Request processed in 1771us (4019us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940346.463894:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788940346.463913:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788940346.463922:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b48a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+3:8464:x1875839738212096:12345-0@lo:104: 00010000:00010000:2.0:1788940346.463932:0:5843:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff89f181520400/0x27a633fcdd4a9ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4a9b3 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940346.463968:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788940346.463973:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b48a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+3:8464:x1875839738212096:12345-0@lo:104: Request processed in 54us (4095us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940346.463987:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1788940346.464005:0:5848:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788940346.464010:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff89f1829db400/0x27a633fcdd4a9d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4a9dd expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940346.464017:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1829db400 already unused, calling callback (ffffffffc1d10c20) 10000000:00010000:2.0:1788940346.464020:0:5848:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff89f1829db400/0x27a633fcdd4a9d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x27a633fcdd4a9dd expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940346.464028:0:5848:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff89f1829db400/0x27a633fcdd4a9d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x27a633fcdd4a9dd expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788940346.464035:0:5848:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff89f1829db400/0x27a633fcdd4a9d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x27a633fcdd4a9dd expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940346.464040:0:5848:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788940346.464064:0:5848:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff89f1829db400/0x27a633fcdd4a9d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4a9dd expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940346.464069:0:5848:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788940346.464084:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff89f1829db400/0x27a633fcdd4a9d6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4a9dd expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940346.464090:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff89f1829db400/0x27a633fcdd4a9d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4a9dd expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940346.464100:0:5848:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940346.464103:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff89f181520400/0x27a633fcdd4a9ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4a9b3 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940346.464116:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f181520400 already unused, calling callback (ffffffffc1d10c20) 10000000:00010000:2.0:1788940346.464119:0:5848:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff89f181520400/0x27a633fcdd4a9ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x27a633fcdd4a9b3 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940346.464126:0:5848:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff89f181520400/0x27a633fcdd4a9ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x27a633fcdd4a9b3 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788940346.464132:0:5848:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff89f181520400/0x27a633fcdd4a9ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x27a633fcdd4a9b3 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940346.464276:0:5848:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788940346.464293:0:5848:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff89f181520400/0x27a633fcdd4a9ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4a9b3 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940346.464298:0:5848:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788940346.464312:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff89f181520400/0x27a633fcdd4a9ac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4a9b3 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940346.464318:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff89f181520400/0x27a633fcdd4a9ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4a9b3 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940346.464331:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940346.464332:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940346.464334:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940346.464341:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940346.464347:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788940346.464357:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3308:1875839738212992:0@lo:103: 00000100:00100000:2.0:1788940346.464388:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940346.464421:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3306:1875839738212864:0@lo:103: 00010000:00010000:0.0:1788940346.464601:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f181521e00/0x27a633fcdd4aa23 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27a633fcdd4aa1c expref: 16 pid: 5855 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940346.464613:0:8464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8464:1875839738211584:0@lo:104: 00010000:00010000:0.0:1788940346.464625:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f082ad3600/0x27a633fcdd4aa15 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27a633fcdd4aa0e expref: 15 pid: 5855 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940346.464633:0:8464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8464:1875839738211712:0@lo:104: 00010000:00010000:0.0:1788940346.464643:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f181520000/0x27a633fcdd4aa07 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27a633fcdd4aa00 expref: 14 pid: 5853 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940346.464663:0:8464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8464:1875839738211840:0@lo:104: 00000100:00100000:0.0:1788940346.464675:0:8464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8464:1875839738211968:0@lo:104: 00000100:00100000:0.0:1788940346.464682:0:8464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8464:1875839738212096:0@lo:104: 00000100:00100000:2.0:1788940346.464815:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788940346.464863:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940346.464872:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738212992 00000100:00100000:2.0:1788940346.464878:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738212992 00010000:00010000:2.0:1788940346.464901:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89f1c21f1e00/0x27a633fcdd4a9b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4a9ac expref: 14 pid: 5854 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940346.464920:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738212864 00000100:00100000:2.0:1788940346.464923:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738212864 00010000:00010000:2.0:1788940346.464932:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89f082ad2000/0x27a633fcdd4a9dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4a9d6 expref: 15 pid: 5854 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940346.464944:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788940346.464951:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c6e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+15:3308:x1875839738212992:12345-0@lo:103: 00010000:00010000:2.0:1788940346.464961:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940346.464965:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89f1c21f1e00/0x27a633fcdd4a9b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4a9ac expref: 15 pid: 5854 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940346.464973:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89f1c21f1e00/0x27a633fcdd4a9b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27a633fcdd4a9ac expref: 15 pid: 5854 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940346.464985:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f1c21f1e00/0x27a633fcdd4a9b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27a633fcdd4a9ac expref: 15 pid: 5854 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940346.464998:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940346.465031:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c6e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+14:3308:x1875839738212992:12345-0@lo:103: Request processed in 81us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940346.465037:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788940346.465051:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788940346.465058:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1841b5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+13:3306:x1875839738212864:12345-0@lo:103: 00010000:00010000:2.0:1788940346.465072:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940346.465076:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89f082ad2000/0x27a633fcdd4a9dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4a9d6 expref: 13 pid: 5854 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940346.465084:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89f082ad2000/0x27a633fcdd4a9dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27a633fcdd4a9d6 expref: 13 pid: 5854 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940346.465094:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f082ad2000/0x27a633fcdd4a9dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27a633fcdd4a9d6 expref: 13 pid: 5854 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940346.465103:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940346.465129:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1841b5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+12:3306:x1875839738212864:12345-0@lo:103: Request processed in 72us (314us total) trans 0 rc 0/0 00010000:00010000:1.0:1788940346.465335:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940346.465391:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788940346.465444:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3308:1875839738212992:0@lo:103: 00000100:00100000:2.0:1788940346.465694:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3306:1875839738212864:0@lo:103: 00000100:00100000:0.0:1788940346.466281:0:8464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8464:1875839738211072:192.168.202.14@tcp:104: 00000100:00100000:0.0:1788940346.466291:0:8464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8464:1875839738211200:192.168.202.14@tcp:104: 00010000:00010000:0.0:1788940346.466323:0:8464:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89f082ad2a00/0x27a633fcdd4aab6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940346.474765:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940346.474814:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940346.474868:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718264832 00000100:00100000:0.0:1788940346.474880:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718264832 00010000:00010000:0.0:1788940346.474922:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89f1c21f1000/0x27a633fcdd4aa7e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5646 expref: 10 pid: 5854 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940346.474959:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718264960 00000100:00100000:0.0:1788940346.474962:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718264960 00010000:00010000:0.0:1788940346.474975:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89f082ad3000/0x27a633fcdd4aa77 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f563f expref: 11 pid: 5853 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940346.474991:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 19 00000100:00100000:0.0:1788940346.475001:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0b05a86-29c8-44a6-9c64-75d9d650043e+11:2353:x1875839718264832:12345-192.168.202.14@tcp:103: 00010000:00010000:0.0:1788940346.475017:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940346.475024:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89f1c21f1000/0x27a633fcdd4aa7e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5646 expref: 11 pid: 5854 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940346.475036:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89f1c21f1000/0x27a633fcdd4aa7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5646 expref: 11 pid: 5854 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940346.475073:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f1c21f1000/0x27a633fcdd4aa7e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5646 expref: 11 pid: 5854 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940346.475089:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940346.475620:0:5845:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788940346.475631:0:5845:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1788940346.475879:0:5847:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788940346.475892:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 20 00000100:00100000:2.0:1788940346.475904:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0b05a86-29c8-44a6-9c64-75d9d650043e+10:2353:x1875839718264960:12345-192.168.202.14@tcp:103: 00010000:00010000:2.0:1788940346.475916:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940346.475922:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89f082ad3000/0x27a633fcdd4aa77 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f563f expref: 10 pid: 5853 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940346.475932:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89f082ad3000/0x27a633fcdd4aa77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f563f expref: 10 pid: 5853 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940346.475956:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f082ad3000/0x27a633fcdd4aa77 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f563f expref: 10 pid: 5853 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940346.475969:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89f082ad2a00/0x27a633fcdd4aab6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940346.475978:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f082ad2a00/0x27a633fcdd4aab6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940346.475994:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89f082ad2a00/0x27a633fcdd4aab6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940346.476001:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89f082ad2a00/0x27a633fcdd4aab6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940346.476009:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89f082ad2a00/0x27a633fcdd4aab6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940346.476015:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89f082ad2a00/0x27a633fcdd4aab6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940346.476021:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad2a00 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:2.0:1788940346.476024:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89f082ad2a00/0x27a633fcdd4aab6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940346.476033:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89f082ad2a00/0x27a633fcdd4aab6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940346.476045:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89f082ad2a00/0x27a633fcdd4aab6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940346.476065:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788940346.476129:0:8464:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89f082ad2a00/0x27a633fcdd4aab6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940346.476138:0:8464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89f082ad2a00/0x27a633fcdd4aab6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940346.476154:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f082ad2a00/0x27a633fcdd4aab6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940346.476257:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0b05a86-29c8-44a6-9c64-75d9d650043e+9:2353:x1875839718264832:12345-192.168.202.14@tcp:103: Request processed in 1255us (1501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940346.476265:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 19 00000100:00100000:2.0:1788940346.476384:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0b05a86-29c8-44a6-9c64-75d9d650043e+8:2353:x1875839718264960:12345-192.168.202.14@tcp:103: Request processed in 483us (1569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940346.476390:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 20 00000100:00100000:2.0:1788940346.882290:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940346.882348:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940346.882386:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940346.882436:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940346.882492:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718265344 00000100:00100000:2.0:1788940346.882503:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718265344 00000100:00100000:2.0:1788940346.882622:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718265472 00000100:00100000:2.0:1788940346.882625:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718265472 00000100:00100000:2.0:1788940346.882654:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 13 00000100:00100000:2.0:1788940346.882678:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+5:2353:x1875839718265344:12345-192.168.202.14@tcp:400: 00000100:00100000:2.0:1788940346.882810:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+5:2353:x1875839718265344:12345-192.168.202.14@tcp:400: Request processed in 98us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940346.882818:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 13 00000100:00100000:2.0:1788940346.882838:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 14 00000100:00100000:2.0:1788940346.882843:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+5:2353:x1875839718265472:12345-192.168.202.14@tcp:400: 00000100:00100000:2.0:1788940346.882869:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+5:2353:x1875839718265472:12345-192.168.202.14@tcp:400: Request processed in 26us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940346.882875:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 14 00000100:00080000:2.0:1788940346.882896:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788940346.882901:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788940346.883249:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718265088 00000100:00100000:3.0:1788940346.883256:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718265088 00000100:00100000:3.0:1788940346.883297:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 134 00000100:00100000:3.0:1788940346.883305:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1980dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+8:2353:x1875839718265088:12345-192.168.202.14@tcp:400: 00000100:00100000:3.0:1788940346.883345:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1980dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+8:2353:x1875839718265088:12345-192.168.202.14@tcp:400: Request processed in 40us (1069us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940346.883351:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 134 00000100:00100000:1.0:1788940346.884590:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718265216 00000100:00100000:1.0:1788940346.884606:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718265216 00000100:00100000:1.0:1788940346.884707:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 31 00000100:00080000:2.0:1788940346.884713:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940346.884723:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2353:x1875839718265216:12345-192.168.202.14@tcp:400: 00000100:00100000:1.0:1788940346.884825:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2353:x1875839718265216:12345-192.168.202.14@tcp:400: Request processed in 109us (2439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940346.884836:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 31 00010000:00010000:1.0:1788940347.054588:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788940347.565472:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788940347.565482:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff89f1bf721000 from 39 10000000:01000000:0.0:1788940347.565489:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788940347.565574:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f082ad2200/0x27a633fcdd4aabd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940347.565590:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f082ad2200/0x27a633fcdd4aabd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940347.565603:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f082ad2200/0x27a633fcdd4aabd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940347.565634:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738213120:0@lo:101: 00000100:00100000:0.0:1788940347.565730:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940347.565813:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1baa6a300 going to sleep for 11 seconds 00000100:00100000:2.0:1788940347.565858:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738213120 00000100:00100000:2.0:1788940347.565892:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738213120 00000100:00100000:2.0:1788940347.565973:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788940347.565985:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1980de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+12:5858:x1875839738213120:12345-0@lo:101: 00010000:00010000:2.0:1788940347.566003:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940347.566023:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f181521a00/0x27a633fcdd4aac4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4aabd expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940347.566055:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f181521a00/0x27a633fcdd4aac4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4aabd expref: 13 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940347.566667:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f181521a00/0x27a633fcdd4aac4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4aabd expref: 13 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940347.566678:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f181521a00, rc 0) 00000100:00100000:2.0:1788940347.566760:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1980de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+13:5858:x1875839738213120:12345-0@lo:101: Request processed in 777us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940347.566778:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788940347.567487:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738213120:0@lo:101: 00010000:00010000:0.0:1788940347.567514:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f082ad2200/0x27a633fcdd4aabd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4aac4 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940347.567546:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f082ad2200/0x27a633fcdd4aabd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4aac4 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940347.567640:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738213248:0@lo:501: 00000100:00100000:0.0:1788940347.567683:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940347.567724:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1baa6a300 going to sleep for 11 seconds 00000100:00100000:2.0:1788940347.567799:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738213248 00000100:00100000:2.0:1788940347.567805:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738213248 00000100:00100000:2.0:1788940347.567854:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788940347.567863:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1980dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+13:5858:x1875839738213248:12345-0@lo:501: 00000100:00100000:2.0:1788940347.568136:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1980dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+13:5858:x1875839738213248:12345-0@lo:501: Request processed in 274us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940347.568144:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788940347.568493:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738213248:0@lo:501: 00000100:00100000:0.0:1788940347.568555:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738213376:0@lo:503: 00000100:00100000:0.0:1788940347.568597:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940347.568624:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1baa6a300 going to sleep for 11 seconds 00000100:00100000:2.0:1788940347.569181:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738213376 00000100:00100000:2.0:1788940347.569188:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738213376 00000100:00100000:2.0:1788940347.569244:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788940347.569253:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1980dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+13:5858:x1875839738213376:12345-0@lo:503: 00000100:00100000:2.0:1788940347.569651:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1980dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+13:5858:x1875839738213376:12345-0@lo:503: Request processed in 398us (1053us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940347.569666:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788940347.569763:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738213376:0@lo:503: 00000100:00100000:0.0:1788940347.570450:0:8482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:8482:1875839738213504:0@lo:502: 00000100:00100000:0.0:1788940347.570501:0:8482:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940347.570565:0:8482:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1baa6a600 going to sleep for 11 seconds 00000100:00100000:3.0:1788940347.570623:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738213504 00000100:00100000:3.0:1788940347.570629:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738213504 00000100:00100000:3.0:1788940347.570668:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788940347.570677:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1980dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+13:8482:x1875839738213504:12345-0@lo:502: 00000100:00100000:3.0:1788940347.570905:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1980dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+13:8482:x1875839738213504:12345-0@lo:502: Request processed in 228us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940347.570913:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788940347.574142:0:8482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:8482:1875839738213504:0@lo:502: 00000100:00100000:1.0:1788940347.574289:0:8482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf554700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:8482:1875839738213632:0@lo:502: 00000100:00100000:1.0:1788940347.574398:0:8482:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940347.574453:0:8482:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1b0c92600 going to sleep for 11 seconds 00000100:00100000:2.0:1788940347.582446:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738213632 00000100:00100000:2.0:1788940347.582465:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738213632 00000100:00100000:2.0:1788940347.582564:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788940347.582577:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1980dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+13:8482:x1875839738213632:12345-0@lo:502: 00000100:00100000:2.0:1788940347.582905:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1980dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+13:8482:x1875839738213632:12345-0@lo:502: Request processed in 330us (8506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940347.582913:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788940347.584642:0:8482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf554700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:8482:1875839738213632:0@lo:502: 00000040:00080000:1.0:1788940347.584706:0:8482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788940347.590815:0:5858:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788940347.590856:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788940347.590869:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f082ad2200/0x27a633fcdd4aabd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4aac4 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940347.590884:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f082ad2200/0x27a633fcdd4aabd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4aac4 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940347.590895:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1788940347.590899:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1788940347.590901:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788940347.590952:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f181520c00/0x27a633fcdd4aacb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940347.590961:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f181520c00/0x27a633fcdd4aacb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940347.590973:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f181520c00/0x27a633fcdd4aacb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940347.591000:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198180a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738213760:0@lo:101: 00000100:00100000:2.0:1788940347.591098:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940347.591150:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1a94fff00 going to sleep for 11 seconds 00000100:00100000:1.0:1788940347.591625:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738213760 00000100:00100000:1.0:1788940347.591641:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738213760 00000100:00100000:1.0:1788940347.591716:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788940347.591728:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1980df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+13:5858:x1875839738213760:12345-0@lo:101: 00010000:00010000:1.0:1788940347.591748:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940347.591779:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f19258d600/0x27a633fcdd4aad2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4aacb expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940347.591811:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f19258d600/0x27a633fcdd4aad2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4aacb expref: 14 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940347.591824:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f19258d600/0x27a633fcdd4aad2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4aacb expref: 14 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940347.591834:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f19258d600, rc 0) 00000100:00100000:1.0:1788940347.591901:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1980df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+14:5858:x1875839738213760:12345-0@lo:101: Request processed in 176us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940347.591908:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788940347.592486:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198180a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738213760:0@lo:101: 00010000:00010000:2.0:1788940347.592509:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f181520c00/0x27a633fcdd4aacb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4aad2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940347.592552:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f181520c00/0x27a633fcdd4aacb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4aad2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940347.592632:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198180a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738213888:0@lo:501: 00000100:00100000:2.0:1788940347.592670:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940347.592708:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1a94fff00 going to sleep for 11 seconds 00000100:00100000:3.0:1788940347.592785:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738213888 00000100:00100000:3.0:1788940347.592792:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738213888 00000100:00100000:3.0:1788940347.592825:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788940347.592832:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1980df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+14:5858:x1875839738213888:12345-0@lo:501: 00000100:00100000:3.0:1788940347.593188:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1980df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+14:5858:x1875839738213888:12345-0@lo:501: Request processed in 355us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940347.593195:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788940347.593420:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198180a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738213888:0@lo:501: 00000100:00100000:2.0:1788940347.593450:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198180a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738214016:0@lo:503: 00000100:00100000:2.0:1788940347.593490:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940347.593515:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1a94fff00 going to sleep for 11 seconds 00000100:00100000:1.0:1788940347.593716:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738214016 00000100:00100000:1.0:1788940347.593722:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738214016 00000100:00100000:1.0:1788940347.593748:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788940347.593755:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1980dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+14:5858:x1875839738214016:12345-0@lo:503: 00000100:00100000:1.0:1788940347.593926:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1980dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+14:5858:x1875839738214016:12345-0@lo:503: Request processed in 171us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940347.593939:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788940347.605129:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198180a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738214016:0@lo:503: 00000100:00100000:1.0:1788940347.606126:0:8483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf554700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:8483:1875839738214144:0@lo:502: 00000100:00100000:1.0:1788940347.606224:0:8483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940347.606271:0:8483:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f188194180 going to sleep for 11 seconds 00000100:00100000:3.0:1788940347.606422:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738214144 00000100:00100000:3.0:1788940347.606430:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738214144 00000100:00100000:3.0:1788940347.606495:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788940347.606504:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1980dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+14:8483:x1875839738214144:12345-0@lo:502: 00000100:00100000:3.0:1788940347.606785:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1980dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+14:8483:x1875839738214144:12345-0@lo:502: Request processed in 281us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940347.606793:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788940347.607381:0:8483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf554700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:8483:1875839738214144:0@lo:502: 00000020:01000000:1.0:1788940347.607419:0:8483:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788940347.607431:0:8483:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940347.607433:0:8483:0:(obd_config.c:1662:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788940347.607439:0:8483:0:(obd_config.c:1571:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788940347.607472:0:8483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf554700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:8483:1875839738214272:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788940347.607510:0:8483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940347.607556:0:8483:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f187ff6180 going to sleep for 11 seconds 00000100:00100000:3.0:1788940347.607643:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738214272 00000100:00100000:3.0:1788940347.607648:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738214272 00000100:00100000:3.0:1788940347.607683:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788940347.607691:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1980de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+14:8483:x1875839738214272:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788940347.607837:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1980de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+14:8483:x1875839738214272:12345-0@lo:502:llog_process_th.0 Request processed in 146us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940347.607845:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788940347.611338:0:8483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf554700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:8483:1875839738214272:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788940347.611401:0:8483:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788940347.611415:0:8483:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940347.611418:0:8483:0:(obd_config.c:1662:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788940347.611424:0:8483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1788940347.611562:0:5858:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1788940347.611596:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788940347.611609:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f181520c00/0x27a633fcdd4aacb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4aad2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940347.611624:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f181520c00/0x27a633fcdd4aacb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4aad2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940347.611636:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788940347.611639:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff89f19016d800 from 39 10000000:01000000:3.0:1788940347.611642:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788940347.611692:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f1829da200/0x27a633fcdd4aad9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940347.611702:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f1829da200/0x27a633fcdd4aad9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940347.611737:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f1829da200/0x27a633fcdd4aad9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940347.611779:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b48a5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738214400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788940347.611855:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940347.611889:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738214400 00000100:00100000:3.0:1788940347.611900:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1862eaf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788940347.611900:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738214400 00000100:00100000:2.0:1788940347.611971:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788940347.611981:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1980df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+14:5858:x1875839738214400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788940347.612011:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940347.612029:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f181520400/0x27a633fcdd4aae0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4aad9 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940347.612070:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f181520400/0x27a633fcdd4aae0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4aad9 expref: 15 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940347.612084:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f181520400/0x27a633fcdd4aae0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4aad9 expref: 15 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940347.612227:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f181520400, rc 0) 00000100:00100000:2.0:1788940347.612305:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1980df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+15:5858:x1875839738214400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 324us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940347.612311:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788940347.612370:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b48a5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738214400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788940347.612392:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f1829da200/0x27a633fcdd4aad9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4aae0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940347.612404:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f1829da200/0x27a633fcdd4aad9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4aae0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940347.612485:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b48a5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738214528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788940347.612558:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940347.612581:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1862eaf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788940347.612827:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738214528 00000100:00100000:1.0:1788940347.612835:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738214528 00000100:00100000:1.0:1788940347.612879:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788940347.612888:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1980dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+15:5858:x1875839738214528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788940347.613357:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1980dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+15:5858:x1875839738214528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 468us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940347.613366:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788940347.613922:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b48a5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738214528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788940347.613996:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198180a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738214656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788940347.614266:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940347.614310:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738214656 00000100:00100000:3.0:1788940347.614397:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1a94ffc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788940347.614539:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738214656 00000100:00100000:1.0:1788940347.614585:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788940347.614593:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18415cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+15:5858:x1875839738214656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788940347.615038:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18415cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+15:5858:x1875839738214656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 442us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940347.615052:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788940347.615086:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198180a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738214656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788940347.615844:0:8484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b48a5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:8484:1875839738214784:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788940347.615909:0:8484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940347.615949:0:8484:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1b0c92cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940347.616047:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738214784 00000100:00100000:2.0:1788940347.616053:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738214784 00000100:00100000:2.0:1788940347.616090:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788940347.616098:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18415d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+15:8484:x1875839738214784:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788940347.616641:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18415d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+15:8484:x1875839738214784:12345-0@lo:502:llog_process_th.0 Request processed in 541us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940347.616650:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788940347.616830:0:8484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b48a5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:8484:1875839738214784:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788940347.616875:0:8484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b48a5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:8484:1875839738214912:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788940347.616905:0:8484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940347.616936:0:8484:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1b5b32b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788940347.616982:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738214912 00000100:00100000:0.0:1788940347.616986:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738214912 00000100:00100000:0.0:1788940347.617017:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788940347.617024:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18415f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+15:8484:x1875839738214912:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788940347.617614:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18415f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+15:8484:x1875839738214912:12345-0@lo:502:llog_process_th.0 Request processed in 589us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940347.617621:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788940347.617712:0:8484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b48a5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:8484:1875839738214912:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788940347.617733:0:8484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788940347.617931:0:5858:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788940347.617960:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788940347.617970:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f1829da200/0x27a633fcdd4aad9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4aae0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940347.617989:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f1829da200/0x27a633fcdd4aad9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4aae0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940347.618000:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788940347.618003:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1788940347.618006:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788940347.618033:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f082ad3e00/0x27a633fcdd4aae7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940347.618042:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f082ad3e00/0x27a633fcdd4aae7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940347.618051:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f082ad3e00/0x27a633fcdd4aae7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940347.618066:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738215040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788940347.618094:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940347.618276:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1834f59c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940347.618394:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738215040 00000100:00100000:2.0:1788940347.618400:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738215040 00000100:00100000:2.0:1788940347.618429:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788940347.618443:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18415f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+15:5858:x1875839738215040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788940347.618454:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940347.618468:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f181520000/0x27a633fcdd4aaee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4aae7 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940347.618491:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f181520000/0x27a633fcdd4aaee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4aae7 expref: 16 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940347.619274:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f181520000/0x27a633fcdd4aaee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4aae7 expref: 16 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940347.619285:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f181520000, rc 0) 00000100:00100000:2.0:1788940347.620493:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18415f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+16:5858:x1875839738215040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2045us (2392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940347.620504:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788940347.620718:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738215040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788940347.620745:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f082ad3e00/0x27a633fcdd4aae7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4aaee expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940347.620758:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f082ad3e00/0x27a633fcdd4aae7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4aaee expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940347.620846:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738215168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788940347.620880:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940347.620925:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1834f59c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788940347.621650:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738215168 00000100:00100000:3.0:1788940347.621661:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738215168 00000100:00100000:3.0:1788940347.621712:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788940347.621721:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18415d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+16:5858:x1875839738215168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788940347.622076:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18415d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+16:5858:x1875839738215168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 354us (1193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940347.622084:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788940347.622268:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738215168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788940347.622330:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf557480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738215296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788940347.622380:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940347.622417:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f187ff63c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788940347.622579:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738215296 00000100:00100000:3.0:1788940347.622584:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738215296 00000100:00100000:3.0:1788940347.622610:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788940347.622616:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18415c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+16:5858:x1875839738215296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788940347.622783:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18415c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+16:5858:x1875839738215296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 165us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940347.622790:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788940347.626709:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf557480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738215296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788940347.627004:0:8485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf557480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:8485:1875839738215424:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788940347.627090:0:8485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940347.627255:0:8485:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f187ff63c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788940347.627336:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738215424 00000100:00100000:0.0:1788940347.627344:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738215424 00000100:00100000:0.0:1788940347.627394:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788940347.627403:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18415e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+16:8485:x1875839738215424:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788940347.627677:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18415e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+16:8485:x1875839738215424:12345-0@lo:502:llog_process_th.0 Request processed in 274us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940347.627685:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788940347.627926:0:8485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf557480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:8485:1875839738215424:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788940347.627952:0:8485:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788940347.627964:0:8485:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940347.627967:0:8485:0:(obd_config.c:1662:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788940347.627972:0:8485:0:(obd_config.c:1571:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788940347.627995:0:8485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf557480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:8485:1875839738215552:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788940347.628027:0:8485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940347.628043:0:8485:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1a0238a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788940347.629670:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738215552 00000100:00100000:0.0:1788940347.629687:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738215552 00000100:00100000:0.0:1788940347.629755:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788940347.629774:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18415f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+16:8485:x1875839738215552:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788940347.630406:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18415f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+16:8485:x1875839738215552:12345-0@lo:502:llog_process_th.0 Request processed in 639us (2376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940347.630416:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788940347.637498:0:8485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf557480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:8485:1875839738215552:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788940347.638923:0:8485:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788940347.638943:0:8485:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940347.638946:0:8485:0:(obd_config.c:1662:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788940347.638953:0:8485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:1.0:1788940347.641807:0:5858:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1788940347.641849:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788940347.641862:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f082ad3e00/0x27a633fcdd4aae7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4aaee expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940347.641877:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f082ad3e00/0x27a633fcdd4aae7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4aaee expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940347.641888:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788940347.641910:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff89f188f09000 from 39 10000000:01000000:1.0:1788940347.641914:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788940347.641959:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f19258da00/0x27a633fcdd4aaf5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940347.641967:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f19258da00/0x27a633fcdd4aaf5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940347.641979:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f19258da00/0x27a633fcdd4aaf5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940347.642008:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf557480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738215680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788940347.642092:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940347.642148:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1a0238a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788940347.642276:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738215680 00000100:00100000:3.0:1788940347.642284:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738215680 00000100:00100000:3.0:1788940347.642337:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788940347.642347:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18415ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+16:5858:x1875839738215680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788940347.642363:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940347.642378:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f1829dbc00/0x27a633fcdd4aafc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4aaf5 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940347.642404:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f1829dbc00/0x27a633fcdd4aafc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4aaf5 expref: 17 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940347.642416:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f1829dbc00/0x27a633fcdd4aafc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4aaf5 expref: 17 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940347.642437:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f1829dbc00, rc 0) 00000100:00100000:3.0:1788940347.642485:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18415ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+17:5858:x1875839738215680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940347.642492:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788940347.642601:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf557480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738215680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788940347.642616:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f19258da00/0x27a633fcdd4aaf5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4aafc expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940347.642626:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f19258da00/0x27a633fcdd4aaf5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4aafc expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940347.642682:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198183100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738215808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788940347.642709:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940347.642733:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1a94ffc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788940347.642836:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738215808 00000100:00100000:0.0:1788940347.642841:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738215808 00000100:00100000:0.0:1788940347.642869:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788940347.642876:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18415dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+17:5858:x1875839738215808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788940347.643303:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18415dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+17:5858:x1875839738215808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 426us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940347.643311:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788940347.643365:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198183100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738215808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788940347.643395:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198183100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738215936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788940347.643439:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940347.643465:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1a94ffc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788940347.643512:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738215936 00000100:00100000:3.0:1788940347.643538:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738215936 00000100:00100000:3.0:1788940347.643562:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788940347.643569:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18415c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+17:5858:x1875839738215936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788940347.643723:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18415c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+17:5858:x1875839738215936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 153us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940347.643730:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788940347.643762:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198183100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738215936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788940347.647707:0:8486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198183b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:8486:1875839738216064:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788940347.647830:0:8486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940347.647882:0:8486:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1a94ffc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788940347.647991:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738216064 00000100:00100000:3.0:1788940347.647999:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738216064 00000100:00100000:3.0:1788940347.648048:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788940347.648057:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18415e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+17:8486:x1875839738216064:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788940347.648364:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18415e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+17:8486:x1875839738216064:12345-0@lo:502:llog_process_th.0 Request processed in 307us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940347.648372:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788940347.648626:0:8486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198183b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:8486:1875839738216064:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788940347.648682:0:8486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf555f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:8486:1875839738216192:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788940347.648719:0:8486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940347.648747:0:8486:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1a0238600 going to sleep for 11 seconds 00000100:00100000:0.0:1788940347.648796:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738216192 00000100:00100000:0.0:1788940347.648802:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738216192 00000100:00100000:0.0:1788940347.648849:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788940347.648856:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18415c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+17:8486:x1875839738216192:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788940347.649000:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18415c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+17:8486:x1875839738216192:12345-0@lo:502:llog_process_th.0 Request processed in 145us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940347.649007:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788940347.649079:0:8486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf555f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:8486:1875839738216192:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788940347.649097:0:8486:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788940347.650641:0:5858:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788940347.650677:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788940347.650691:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f19258da00/0x27a633fcdd4aaf5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4aafc expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940347.650707:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f19258da00/0x27a633fcdd4aaf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4aafc expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940347.650719:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788940347.650722:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1788940347.650725:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788940347.650785:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f082ad2400/0x27a633fcdd4ab03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940347.650794:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f082ad2400/0x27a633fcdd4ab03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940347.650806:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f082ad2400/0x27a633fcdd4ab03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940347.650831:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738216320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788940347.650893:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940347.650932:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f195ed3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788940347.651025:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738216320 00000100:00100000:2.0:1788940347.651033:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738216320 00000100:00100000:2.0:1788940347.651082:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788940347.651091:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18415e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+17:5858:x1875839738216320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788940347.651112:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940347.651128:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f181521e00/0x27a633fcdd4ab0a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4ab03 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940347.651155:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f181521e00/0x27a633fcdd4ab0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4ab03 expref: 18 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940347.651167:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f181521e00/0x27a633fcdd4ab0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4ab03 expref: 18 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940347.651177:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f181521e00, rc 0) 00000100:00100000:2.0:1788940347.651222:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18415e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+18:5858:x1875839738216320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940347.651229:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788940347.651935:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738216320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788940347.651972:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f082ad2400/0x27a633fcdd4ab03 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4ab0a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940347.651984:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f082ad2400/0x27a633fcdd4ab03 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4ab0a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940347.652051:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738216448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788940347.652084:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940347.652117:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f195ed3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788940347.652169:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738216448 00000100:00100000:2.0:1788940347.652173:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738216448 00000100:00100000:2.0:1788940347.652205:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788940347.652212:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18415fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+18:5858:x1875839738216448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788940347.656203:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18415fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+18:5858:x1875839738216448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 3976us (4103us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940347.656241:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788940347.657068:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738216448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788940347.657349:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738216576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788940347.657429:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940347.657501:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f195ed3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788940347.658979:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738216576 00000100:00100000:1.0:1788940347.658995:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738216576 00000100:00100000:0.0:1788940347.659134:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788940347.659145:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18415d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+18:5858:x1875839738216576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788940347.659424:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18415d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+18:5858:x1875839738216576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 280us (1993us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940347.659432:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788940347.659567:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738216576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788940347.660121:0:8487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:8487:1875839738216704:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788940347.660172:0:8487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940347.660208:0:8487:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f195ed3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788940347.660250:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738216704 00000100:00100000:3.0:1788940347.660255:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738216704 00000100:00100000:3.0:1788940347.660289:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788940347.660295:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+18:8487:x1875839738216704:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788940347.660492:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+18:8487:x1875839738216704:12345-0@lo:502:llog_process_th.0 Request processed in 196us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940347.660499:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788940347.660740:0:8487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:8487:1875839738216704:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788940347.660781:0:8487:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788940347.660792:0:8487:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940347.660795:0:8487:0:(obd_config.c:1662:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788940347.660802:0:8487:0:(obd_config.c:1571:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788940347.660825:0:8487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf555f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:8487:1875839738216832:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788940347.660861:0:8487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940347.660890:0:8487:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1a0238600 going to sleep for 11 seconds 00000100:00100000:0.0:1788940347.660986:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738216832 00000100:00100000:0.0:1788940347.660991:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738216832 00000100:00100000:0.0:1788940347.661024:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788940347.661030:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+18:8487:x1875839738216832:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788940347.661207:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+18:8487:x1875839738216832:12345-0@lo:502:llog_process_th.0 Request processed in 176us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940347.661214:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788940347.661279:0:8487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf555f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:8487:1875839738216832:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788940347.661297:0:8487:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788940347.661301:0:8487:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940347.661303:0:8487:0:(obd_config.c:1662:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788940347.661307:0:8487:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1788940347.661504:0:5858:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1788940347.661553:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788940347.661565:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f082ad2400/0x27a633fcdd4ab03 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4ab0a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940347.661577:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f082ad2400/0x27a633fcdd4ab03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4ab0a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940347.661589:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788940347.661592:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff89f1982e0000 from 1 10000000:01000000:0.0:1788940347.661595:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788940347.661623:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f082ad3600/0x27a633fcdd4ab11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940347.661631:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f082ad3600/0x27a633fcdd4ab11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940347.661641:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f082ad3600/0x27a633fcdd4ab11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940347.661654:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738216960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788940347.661683:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940347.661701:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f195ed3780 going to sleep for 11 seconds 00000100:00100000:3.0:1788940347.661750:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738216960 00000100:00100000:3.0:1788940347.661754:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738216960 00000100:00100000:3.0:1788940347.661783:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788940347.661790:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+18:5858:x1875839738216960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788940347.661799:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940347.661813:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f1829db800/0x27a633fcdd4ab18 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4ab11 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940347.661837:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f1829db800/0x27a633fcdd4ab18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4ab11 expref: 19 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940347.661849:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f1829db800/0x27a633fcdd4ab18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4ab11 expref: 19 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940347.661861:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f1829db800, rc 0) 00000100:00100000:3.0:1788940347.661896:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:5858:x1875839738216960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940347.661902:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788940347.661998:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738216960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788940347.662013:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f082ad3600/0x27a633fcdd4ab11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4ab18 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940347.662030:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f082ad3600/0x27a633fcdd4ab11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4ab18 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940347.662073:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738217088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788940347.662097:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940347.662207:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f195ed3780 going to sleep for 11 seconds 00000100:00100000:3.0:1788940347.665799:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738217088 00000100:00100000:3.0:1788940347.665817:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738217088 00000100:00100000:3.0:1788940347.665899:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788940347.665908:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:5858:x1875839738217088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788940347.666279:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:5858:x1875839738217088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 371us (4179us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788940347.666289:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788940347.666437:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738217088:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1788940347.666490:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788940347.666501:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f082ad3600/0x27a633fcdd4ab11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4ab18 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940347.666514:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f082ad3600/0x27a633fcdd4ab11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4ab18 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940348.079589:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940348.909012:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788940348.909049:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198182d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738217216:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788940348.909838:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940348.910029:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738217216 00000100:00100000:2.0:1788940348.910045:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738217216 00000100:00100000:2.0:1788940348.910206:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788940348.910231:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf555880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738217216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788940348.910277:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788940348.910360:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf555880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738217216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 137us (1210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940348.910367:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1788940348.911066:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f198182d80 x1875839738217216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940364 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788940348.911088:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788940348.912291:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198182d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738217216:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788940349.101323:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940349.111641:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940349.117970:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718265600 00000100:00100000:3.0:1788940349.117991:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718265600 00000100:00100000:3.0:1788940349.118084:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 167 00000100:00100000:3.0:1788940349.118096:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+8:5599:x1875839718265600:12345-192.168.202.14@tcp:101: 00010000:00010000:3.0:1788940349.118115:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940349.118134:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f1829dae00/0x27a633fcdd4ab1f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f56a8 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940349.118166:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f1829dae00/0x27a633fcdd4ab1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f56a8 expref: 9 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940349.118178:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f1829dae00/0x27a633fcdd4ab1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f56a8 expref: 9 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940349.118188:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f1829dae00, rc 0) 00000100:00100000:3.0:1788940349.118279:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+9:5599:x1875839718265600:12345-192.168.202.14@tcp:101: Request processed in 184us (6648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940349.118286:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 167 00000100:00100000:3.0:1788940349.122619:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940349.122691:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718265728 00000100:00100000:0.0:1788940349.122707:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718265728 00000100:00100000:0.0:1788940349.122795:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 168 00000100:00100000:0.0:1788940349.122811:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0b05a86-29c8-44a6-9c64-75d9d650043e+9:5599:x1875839718265728:12345-192.168.202.14@tcp:501: 00000100:00100000:0.0:1788940349.123129:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0b05a86-29c8-44a6-9c64-75d9d650043e+9:5599:x1875839718265728:12345-192.168.202.14@tcp:501: Request processed in 323us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940349.123137:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 168 00000100:00100000:3.0:1788940349.125142:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940349.129273:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718265856 00000100:00100000:0.0:1788940349.129293:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718265856 00000100:00100000:0.0:1788940349.129385:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 169 00000100:00100000:0.0:1788940349.129398:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0b05a86-29c8-44a6-9c64-75d9d650043e+9:5599:x1875839718265856:12345-192.168.202.14@tcp:503: 00000100:00100000:0.0:1788940349.129710:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0b05a86-29c8-44a6-9c64-75d9d650043e+9:5599:x1875839718265856:12345-192.168.202.14@tcp:503: Request processed in 313us (4590us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940349.129730:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 169 00000100:00100000:3.0:1788940349.133282:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940349.134004:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718265984 00000100:00100000:0.0:1788940349.134021:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718265984 00000100:00100000:0.0:1788940349.134103:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 170 00000100:00100000:0.0:1788940349.134115:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0b05a86-29c8-44a6-9c64-75d9d650043e+9:6078:x1875839718265984:12345-192.168.202.14@tcp:502: 00000100:00100000:0.0:1788940349.134913:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0b05a86-29c8-44a6-9c64-75d9d650043e+9:6078:x1875839718265984:12345-192.168.202.14@tcp:502: Request processed in 794us (1640us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940349.134924:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 170 00000100:00100000:0.0:1788940349.139853:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940349.148187:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718266112 00000100:00100000:1.0:1788940349.148207:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718266112 00000100:00100000:0.0:1788940349.148429:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 171 00000100:00100000:0.0:1788940349.148442:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0b05a86-29c8-44a6-9c64-75d9d650043e+9:6078:x1875839718266112:12345-192.168.202.14@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788940349.148801:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0b05a86-29c8-44a6-9c64-75d9d650043e+9:6078:x1875839718266112:12345-192.168.202.14@tcp:502:llog_process_th.0 Request processed in 360us (8956us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940349.148809:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 171 00000100:00100000:3.0:1788940349.154704:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940349.155077:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718266240 00000100:00100000:0.0:1788940349.155090:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718266240 00000100:00100000:0.0:1788940349.155164:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 172 00000100:00100000:0.0:1788940349.155174:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0b05a86-29c8-44a6-9c64-75d9d650043e+9:5599:x1875839718266240:12345-192.168.202.14@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788940349.155195:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940349.155225:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f082ad3000/0x27a633fcdd4ab26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f56af expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940349.155260:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f082ad3000/0x27a633fcdd4ab26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f56af expref: 10 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940349.155279:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f082ad3000/0x27a633fcdd4ab26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f56af expref: 10 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940349.155290:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f082ad3000, rc 0) 00000100:00100000:0.0:1788940349.155357:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0b05a86-29c8-44a6-9c64-75d9d650043e+10:5599:x1875839718266240:12345-192.168.202.14@tcp:101:ll_cfg_requeue.0 Request processed in 185us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940349.155364:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 172 00000100:00100000:2.0:1788940349.158041:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940349.158269:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718266368 00000100:00100000:3.0:1788940349.158286:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718266368 00000100:00100000:3.0:1788940349.158361:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 173 00000100:00100000:3.0:1788940349.158376:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+10:5599:x1875839718266368:12345-192.168.202.14@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788940349.158945:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+10:5599:x1875839718266368:12345-192.168.202.14@tcp:501:ll_cfg_requeue.0 Request processed in 573us (914us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788940349.158955:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 173 00000100:00100000:2.0:1788940349.934683:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198181880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738217728:0@lo:400:kworker.0 00000100:00100000:2.0:1788940349.934815:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940349.935009:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198183480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875839738217600:0@lo:400:kworker.0 00000100:00100000:0.0:1788940349.935049:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940349.935104:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738217728 00000100:00100000:0.0:1788940349.935113:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738217728 00000100:00100000:0.0:1788940349.935173:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788940349.935183:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f198183b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738217728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940349.935240:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f198183b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738217728:12345-0@lo:400:kworker.0 Request processed in 58us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940349.935249:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788940349.935371:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875839738217472:0@lo:400:kworker.0 00010000:00080000:2.0:1788940349.935463:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f198181880 x1875839738217728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940365 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940349.935464:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940349.935489:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198181880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738217728:0@lo:400:kworker.0 00000100:00100000:3.0:1788940349.935556:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198182d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738217984:0@lo:400:kworker.0 00000100:00100000:2.0:1788940349.935588:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738217600 00000100:00100000:3.0:1788940349.935598:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940349.935598:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738217600 00000100:00100000:2.0:1788940349.935667:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738217472 00000100:00100000:3.0:1788940349.935669:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788940349.935674:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738217472 00000100:00100000:3.0:1788940349.935682:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198183800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3306:1875839738217344:0@lo:400:kworker.0 00000100:00100000:2.0:1788940349.935707:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788940349.935723:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f0821c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875839738217600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940349.935725:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940349.935852:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788940349.935869:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b48a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875839738217472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940349.935934:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198180700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875839738217856:0@lo:400:kworker.0 00000100:00100000:2.0:1788940349.937149:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f0821c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875839738217600:12345-0@lo:400:kworker.0 Request processed in 1426us (2092us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940349.937180:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788940349.937227:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738217984 00000100:00100000:2.0:1788940349.937235:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738217984 00000100:00100000:2.0:1788940349.937846:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788940349.937862:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b48a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738217984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940349.938038:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b48a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738217984:12345-0@lo:400:kworker.0 Request processed in 180us (2443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940349.938600:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b48a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875839738217472:12345-0@lo:400:kworker.0 Request processed in 2730us (3129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940349.938614:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788940349.938665:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738217344 00000100:00100000:1.0:1788940349.938673:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738217344 00000100:00100000:1.0:1788940349.938720:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788940349.938727:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3306:x1875839738217344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940349.938785:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3306:x1875839738217344:12345-0@lo:400:kworker.0 Request processed in 58us (3067us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940349.938793:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788940349.938895:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198183480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875839738217600:0@lo:400:kworker.0 00000100:00080000:1.0:1788940349.939062:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788940349.939068:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788940349.944561:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940349.944645:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875839738217472:0@lo:400:kworker.0 00010000:00080000:3.0:1788940349.944663:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f198182d80 x1875839738217984/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940365 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940349.944674:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198182d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738217984:0@lo:400:kworker.0 00000100:00100000:3.0:1788940349.944699:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198183800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3306:1875839738217344:0@lo:400:kworker.0 00000100:00100000:1.0:1788940349.944822:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738217856 00000100:00100000:1.0:1788940349.944854:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738217856 00000100:00100000:1.0:1788940349.944929:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1788940349.945077:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940349.945148:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b48a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875839738217856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940349.945505:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b48a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875839738217856:12345-0@lo:400:kworker.0 Request processed in 362us (951us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940349.945513:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788940349.945613:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198180700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875839738217856:0@lo:400:kworker.0 00000100:00100000:2.0:1788940349.965567:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:2.0:1788940350.124874:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940350.444647:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788940350.444670:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b48a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738218112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788940350.444736:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940350.444811:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738218112 00000100:00100000:3.0:1788940350.444820:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738218112 00000100:00100000:3.0:1788940350.444864:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788940350.444872:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b48a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738218112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788940350.444907:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788940350.444948:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b48a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738218112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940350.444955:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1788940350.444992:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1b48a4700 x1875839738218112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940366 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940350.445011:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b48a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738218112:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788940351.154089:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788940351.154837:0:8528:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe54d38da0 20000000:00000080:2.0:1788940351.154858:0:8528:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff89f1b542b400 uarg=0000000000000000 20000000:01000000:2.0:1788940351.154915:0:8528:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788940351.154924:0:8528:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788940351.154930:0:8528:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788940351.156383:0:8529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1788940351.156631:0:8528:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1788940351.159181:0:8528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1788940351.159249:0:8528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1788940351.159300:0:8528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1788940351.159322:0:8528:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788940351.159347:0:8528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89f181521400/0x27a633fcdd4ab2d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940351.159372:0:8528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89f180031000/0x27a633fcdd4a8a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4a89b expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940351.159380:0:8528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89f1829db200/0x27a633fcdd4a904 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4a8fd expref: 18 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940351.159388:0:8528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89f1c21f0a00/0x27a633fcdd4a9cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4a9c8 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940351.159407:0:8528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89f082ad3800/0x27a633fcdd4aa8c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5677 expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940351.159417:0:8528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89f181521400/0x27a633fcdd4ab2d lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940351.159462:0:8528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89f082ad3800/0x27a633fcdd4aa8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5677 expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940351.159478:0:8528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89f082ad3800/0x27a633fcdd4aa8c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5677 expref: 9 pid: 5854 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940351.159492:0:8528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198181880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8528:1875839738218240:192.168.202.14@tcp:104: 00010000:00010000:2.0:1788940351.159653:0:8528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89f1c21f0a00/0x27a633fcdd4a9cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27a633fcdd4a9c8 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940351.159662:0:8528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89f1c21f0a00/0x27a633fcdd4a9cf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27a633fcdd4a9c8 expref: 18 pid: 5853 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940351.159672:0:8528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198183100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8528:1875839738218368:0@lo:104: 00000100:00100000:2.0:1788940351.159725:0:8528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788940351.159780:0:8528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89f1829db200/0x27a633fcdd4a904 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27a633fcdd4a8fd expref: 18 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940351.159789:0:8528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89f1829db200/0x27a633fcdd4a904 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27a633fcdd4a8fd expref: 18 pid: 5854 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940351.159789:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738218368 00000100:00100000:0.0:1788940351.159800:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738218368 00000100:00100000:2.0:1788940351.159802:0:8528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198180700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8528:1875839738218496:0@lo:104: 00000100:00100000:2.0:1788940351.159844:0:8528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940351.161766:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738218496 00000100:00100000:0.0:1788940351.161777:0:5844:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788940351.161784:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738218496 00000100:00100000:0.0:1788940351.161811:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788940351.161827:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f198180a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+4:8528:x1875839738218368:12345-0@lo:104: 00000100:00100000:1.0:1788940351.161836:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788940351.161842:0:5843:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 3 min 2 max 56 00010000:00010000:0.0:1788940351.161847:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff89f1c21f0200/0x27a633fcdd4a9c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4a9cf expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940351.161850:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf59d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+4:8528:x1875839738218496:12345-0@lo:104: 00010000:00010000:2.0:1788940351.161853:0:8528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89f180031000/0x27a633fcdd4a8a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27a633fcdd4a89b expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940351.161857:0:5843:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_003' 00010000:00010000:2.0:1788940351.161878:0:8528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89f180031000/0x27a633fcdd4a8a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27a633fcdd4a89b expref: 18 pid: 5855 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940351.161894:0:8528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198183800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8528:1875839738218624:0@lo:104: 00000100:00100000:2.0:1788940351.162006:0:8528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940351.162027:0:8528:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1b0ca03c0 going to sleep for 11 seconds 00010000:00010000:0.0:1788940351.162041:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788940351.162055:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f198180a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+4:8528:x1875839738218368:12345-0@lo:104: Request processed in 232us (2330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940351.162066:0:8528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198183100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8528:1875839738218368:0@lo:104: 00000100:00100000:0.0:1788940351.162066:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788940351.162092:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738218624 00000100:00100000:0.0:1788940351.162098:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738218624 00000100:00100000:0.0:1788940351.162112:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788940351.162118:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f198182d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+4:8528:x1875839738218624:12345-0@lo:104: 00010000:00010000:0.0:1788940351.162127:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff89f181521600/0x27a633fcdd4a89b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4a8a2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940351.162178:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788940351.162184:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f198182d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+4:8528:x1875839738218624:12345-0@lo:104: Request processed in 66us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940351.162190:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1788940351.162215:0:7648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788940351.162223:0:7648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff89f1c21f0200/0x27a633fcdd4a9c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4a9cf expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940351.162232:0:7648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1c21f0200 already unused, calling callback (ffffffffc1d10c20) 10000000:00010000:0.0:1788940351.162237:0:7648:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff89f1c21f0200/0x27a633fcdd4a9c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x27a633fcdd4a9cf expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940351.162247:0:7648:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff89f1c21f0200/0x27a633fcdd4a9c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x27a633fcdd4a9cf expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788940351.162255:0:7648:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff89f1c21f0200/0x27a633fcdd4a9c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x27a633fcdd4a9cf expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940351.162262:0:7648:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788940351.162321:0:7648:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff89f1c21f0200/0x27a633fcdd4a9c8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4a9cf expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940351.162334:0:7648:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788940351.162386:0:8528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198183800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8528:1875839738218624:0@lo:104: 00010000:00010000:1.0:1788940351.162459:0:8469:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff89f1c21f1200/0x27a633fcdd4a8fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4a904 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940351.162506:0:7648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff89f1c21f0200/0x27a633fcdd4a9c8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4a9cf expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940351.162516:0:7648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff89f1c21f0200/0x27a633fcdd4a9c8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4a9cf expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940351.162541:0:8469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788940351.162547:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf59d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+3:8528:x1875839738218496:12345-0@lo:104: Request processed in 703us (2703us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940351.162554:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:0.0:1788940351.162555:0:7648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788940351.162560:0:7648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff89f181521600/0x27a633fcdd4a89b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4a8a2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940351.162567:0:7648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f181521600 already unused, calling callback (ffffffffc1d10c20) 10000000:00010000:0.0:1788940351.162570:0:7648:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff89f181521600/0x27a633fcdd4a89b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x27a633fcdd4a8a2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940351.162578:0:7648:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff89f181521600/0x27a633fcdd4a89b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x27a633fcdd4a8a2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788940351.162585:0:7648:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff89f181521600/0x27a633fcdd4a89b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x27a633fcdd4a8a2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940351.162591:0:7648:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788940351.162607:0:7648:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff89f181521600/0x27a633fcdd4a89b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4a8a2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940351.162614:0:7648:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788940351.162619:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940351.162627:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff89f1c21f1200/0x27a633fcdd4a8fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4a904 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940351.162635:0:7648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff89f181521600/0x27a633fcdd4a89b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4a8a2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940351.162636:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1c21f1200 already unused, calling callback (ffffffffc1d10c20) 10000000:00010000:1.0:1788940351.162643:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff89f1c21f1200/0x27a633fcdd4a8fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x27a633fcdd4a904 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940351.162648:0:7648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff89f181521600/0x27a633fcdd4a89b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4a8a2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940351.162654:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff89f1c21f1200/0x27a633fcdd4a8fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x27a633fcdd4a904 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940351.162679:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940351.162682:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940351.162686:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:1.0:1788940351.162692:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff89f1c21f1200/0x27a633fcdd4a8fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x27a633fcdd4a904 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940351.162697:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940351.162699:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3308:1875839738218752:0@lo:103:ldlm_bl.0 10000000:01000000:1.0:1788940351.162701:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788940351.162729:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff89f1c21f1200/0x27a633fcdd4a8fd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4a904 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940351.162730:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3305:1875839738218880:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788940351.162757:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788940351.162764:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788940351.162768:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff89f1c21f1200/0x27a633fcdd4a8fd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4a904 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940351.162777:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff89f1c21f1200/0x27a633fcdd4a8fd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4a904 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940351.163014:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf554000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3306:1875839738219008:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788940351.163118:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940351.163163:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738218752 00000100:00100000:0.0:1788940351.163170:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738218752 00010000:00010000:0.0:1788940351.163196:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89f1c21f0a00/0x27a633fcdd4a9cf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4a9c8 expref: 19 pid: 5853 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940351.163231:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738219008 00000100:00100000:0.0:1788940351.163235:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738219008 00010000:00010000:0.0:1788940351.163248:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89f1829db200/0x27a633fcdd4a904 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4a8fd expref: 20 pid: 5854 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940351.163279:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788940351.163288:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788940351.163289:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b48a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+20:3308:x1875839738218752:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788940351.163302:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b48a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+20:3306:x1875839738219008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788940351.163305:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940351.163314:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89f1c21f0a00/0x27a633fcdd4a9cf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4a9c8 expref: 20 pid: 5853 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940351.163317:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788940351.163322:0:8528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198180700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8528:1875839738218496:0@lo:104: 00010000:00010000:3.0:1788940351.163327:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89f1829db200/0x27a633fcdd4a904 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4a8fd expref: 20 pid: 5854 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940351.163328:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89f1c21f0a00/0x27a633fcdd4a9cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27a633fcdd4a9c8 expref: 20 pid: 5853 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940351.163370:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f1c21f0a00/0x27a633fcdd4a9cf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27a633fcdd4a9c8 expref: 20 pid: 5853 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940351.163372:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89f1829db200/0x27a633fcdd4a904 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27a633fcdd4a8fd expref: 20 pid: 5854 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940351.163396:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f1829db200/0x27a633fcdd4a904 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27a633fcdd4a8fd expref: 19 pid: 5854 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940351.163398:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788940351.163409:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940351.163454:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b48a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+18:3306:x1875839738219008:12345-0@lo:103:ldlm_bl.0 Request processed in 155us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940351.163461:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b48a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+18:3308:x1875839738218752:12345-0@lo:103:ldlm_bl.0 Request processed in 172us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940351.163466:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788940351.163475:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788940351.163483:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf554000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3306:1875839738219008:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788940351.163508:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940351.163510:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3308:1875839738218752:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788940351.163512:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940351.163515:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940351.163562:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940351.163657:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738218880 00000100:00100000:1.0:1788940351.163662:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738218880 00010000:00010000:1.0:1788940351.163679:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89f180031000/0x27a633fcdd4a8a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4a89b expref: 17 pid: 5855 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940351.163710:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788940351.163717:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f198182300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+17:3305:x1875839738218880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788940351.163725:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940351.163729:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89f180031000/0x27a633fcdd4a8a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4a89b expref: 17 pid: 5855 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940351.163747:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89f180031000/0x27a633fcdd4a8a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27a633fcdd4a89b expref: 17 pid: 5855 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940351.163765:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f180031000/0x27a633fcdd4a8a2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27a633fcdd4a89b expref: 17 pid: 5855 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940351.163775:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940351.163809:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f198182300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+16:3305:x1875839738218880:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940351.163817:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788940351.163830:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3305:1875839738218880:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788940351.169023:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940351.169571:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718266496 00000100:00100000:0.0:1788940351.169593:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718266496 00000100:00100000:2.0:1788940351.170851:0:8528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198181880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8528:1875839738218240:192.168.202.14@tcp:104: 00010000:00010000:2.0:1788940351.170899:0:8528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89f181521400/0x27a633fcdd4ab2d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940351.171615:0:5845:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89f082ad3800/0x27a633fcdd4aa8c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5677 expref: 10 pid: 5854 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940351.171670:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 24 00000100:00100000:0.0:1788940351.171690:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b48a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0b05a86-29c8-44a6-9c64-75d9d650043e+10:2353:x1875839718266496:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940351.171707:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940351.171714:0:5845:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89f082ad3800/0x27a633fcdd4aa8c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5677 expref: 10 pid: 5854 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940351.171727:0:5845:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89f082ad3800/0x27a633fcdd4aa8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5677 expref: 10 pid: 5854 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940351.171758:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f082ad3800/0x27a633fcdd4aa8c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5677 expref: 10 pid: 5854 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940351.171778:0:5845:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89f181521400/0x27a633fcdd4ab2d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940351.171787:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f181521400/0x27a633fcdd4ab2d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940351.171808:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89f181521400/0x27a633fcdd4ab2d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940351.172687:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89f181521400/0x27a633fcdd4ab2d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940351.172726:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89f181521400/0x27a633fcdd4ab2d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940351.172749:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89f181521400/0x27a633fcdd4ab2d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940351.172757:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f181521400 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:0.0:1788940351.172762:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89f181521400/0x27a633fcdd4ab2d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940351.172772:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89f181521400/0x27a633fcdd4ab2d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940351.172788:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89f181521400/0x27a633fcdd4ab2d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940351.172803:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788940351.173116:0:8528:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89f181521400/0x27a633fcdd4ab2d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940351.173235:0:8528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89f181521400/0x27a633fcdd4ab2d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940351.173242:0:8528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f181521400/0x27a633fcdd4ab2d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940351.174315:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b48a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0b05a86-29c8-44a6-9c64-75d9d650043e+9:2353:x1875839718266496:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 2623us (5294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940351.174330:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 24 00000100:00100000:3.0:1788940351.992137:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940351.998473:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940351.998533:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940351.998565:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940351.998599:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718266880 00000100:00100000:2.0:1788940351.998611:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718266880 00000100:00100000:2.0:1788940351.998672:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718267008 00000100:00100000:2.0:1788940351.998675:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718267008 00000100:00100000:2.0:1788940351.998699:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 17 00000100:00100000:2.0:1788940351.998709:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f198181880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+5:2351:x1875839718266880:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788940351.998797:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f198181880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+5:2351:x1875839718266880:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 88us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940351.998806:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 17 00000100:00100000:2.0:1788940351.998825:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 18 00000100:00100000:2.0:1788940351.998832:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f198183800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+5:2351:x1875839718267008:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788940351.998858:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f198183800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+5:2351:x1875839718267008:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 27us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940351.998864:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 18 00000100:00100000:2.0:1788940351.998882:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718266752 00000100:00100000:2.0:1788940351.998886:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718266752 00000100:00100000:2.0:1788940351.998917:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 35 00000100:00100000:2.0:1788940351.998925:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f198180700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2351:x1875839718266752:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788940351.998952:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f198180700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2351:x1875839718266752:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 28us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940351.998958:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 35 00000100:00080000:3.0:1788940351.999386:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788940351.999392:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788940351.999394:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788940351.999650:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718266624 00000100:00100000:0.0:1788940351.999655:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718266624 00000100:00100000:0.0:1788940351.999695:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 175 00000100:00100000:0.0:1788940351.999702:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0b05a86-29c8-44a6-9c64-75d9d650043e+9:2351:x1875839718266624:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788940352.000010:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0b05a86-29c8-44a6-9c64-75d9d650043e+9:2351:x1875839718266624:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 306us (7881us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940352.000017:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 175 00010000:00010000:2.0:1788940352.182126:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940352.251070:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940352.255472:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718267136 00000100:00100000:0.0:1788940352.256275:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718267136 00000100:00100000:0.0:1788940352.257125:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 176 00000100:00100000:0.0:1788940352.257149:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+9:5599:x1875839718267136:12345-192.168.202.14@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788940352.257173:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940352.257205:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f082ad2600/0x27a633fcdd4ab34 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f56b6 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940352.257239:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f082ad2600/0x27a633fcdd4ab34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f56b6 expref: 10 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940352.257252:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f082ad2600/0x27a633fcdd4ab34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f56b6 expref: 10 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940352.257263:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f082ad2600, rc 0) 00000100:00100000:0.0:1788940352.257365:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+10:5599:x1875839718267136:12345-192.168.202.14@tcp:101:ll_cfg_requeue.0 Request processed in 220us (6311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940352.257373:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 176 00000100:00100000:0.0:1788940352.264353:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940352.270945:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718267264 00000100:00100000:1.0:1788940352.270967:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718267264 00000100:00100000:2.0:1788940352.271309:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 177 00000100:00100000:2.0:1788940352.271324:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0b05a86-29c8-44a6-9c64-75d9d650043e+10:5599:x1875839718267264:12345-192.168.202.14@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788940352.271745:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0b05a86-29c8-44a6-9c64-75d9d650043e+10:5599:x1875839718267264:12345-192.168.202.14@tcp:501:ll_cfg_requeue.0 Request processed in 423us (7403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940352.271754:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 177 00000100:00100000:0.0:1788940352.274915:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940352.275031:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718267392 00000100:00100000:2.0:1788940352.275045:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718267392 00000100:00100000:2.0:1788940352.275109:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 178 00000100:00100000:2.0:1788940352.275121:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+10:5599:x1875839718267392:12345-192.168.202.14@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788940352.275622:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+10:5599:x1875839718267392:12345-192.168.202.14@tcp:503:ll_cfg_requeue.0 Request processed in 501us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940352.275631:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 178 00000100:00100000:2.0:1788940352.281036:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940352.281120:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718267520 00000100:00100000:0.0:1788940352.281133:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718267520 00000100:00100000:0.0:1788940352.281207:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 179 00000100:00100000:0.0:1788940352.281220:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18416d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0b05a86-29c8-44a6-9c64-75d9d650043e+10:6135:x1875839718267520:12345-192.168.202.14@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788940352.281593:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18416d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0b05a86-29c8-44a6-9c64-75d9d650043e+10:6135:x1875839718267520:12345-192.168.202.14@tcp:502:llog_process_th.0 Request processed in 374us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940352.281601:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 179 00000100:00100000:2.0:1788940352.290662:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940352.293823:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718267648 00000100:00100000:0.0:1788940352.293852:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718267648 00000100:00100000:0.0:1788940352.293926:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 180 00000100:00100000:0.0:1788940352.293938:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18416f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0b05a86-29c8-44a6-9c64-75d9d650043e+10:6135:x1875839718267648:12345-192.168.202.14@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788940352.294253:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18416f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0b05a86-29c8-44a6-9c64-75d9d650043e+10:6135:x1875839718267648:12345-192.168.202.14@tcp:502:llog_process_th.0 Request processed in 316us (3604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940352.294261:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 180 10000000:01000000:0.0:1788940352.628371:0:5858:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788940352.628383:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89f1bf721000 from 4 10000000:01000000:0.0:1788940352.628388:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788940352.628442:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f082ad3c00/0x27a633fcdd4ab3b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940352.628455:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f082ad3c00/0x27a633fcdd4ab3b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940352.628466:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f082ad3c00/0x27a633fcdd4ab3b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940352.628505:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738219136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788940352.628599:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940352.628658:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f18dd30000 going to sleep for 11 seconds 00000100:00100000:2.0:1788940352.628819:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738219136 00000100:00100000:2.0:1788940352.628829:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738219136 00000100:00100000:2.0:1788940352.628889:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788940352.628899:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18416e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+16:5858:x1875839738219136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788940352.628916:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940352.628931:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f181521400/0x27a633fcdd4ab42 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4ab3b expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940352.628962:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f181521400/0x27a633fcdd4ab42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4ab3b expref: 17 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940352.628975:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f181521400/0x27a633fcdd4ab42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4ab3b expref: 17 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940352.628997:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f181521400, rc 0) 00000100:00100000:2.0:1788940352.629046:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18416e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+17:5858:x1875839738219136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940352.629052:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788940352.629123:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738219136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788940352.629140:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f082ad3c00/0x27a633fcdd4ab3b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4ab42 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940352.629150:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f082ad3c00/0x27a633fcdd4ab3b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4ab42 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940352.629216:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198183100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738219264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788940352.629245:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940352.629268:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1b0ca0480 going to sleep for 11 seconds 00000100:00100000:2.0:1788940352.629282:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738219264 00000100:00100000:2.0:1788940352.629286:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738219264 00000100:00100000:2.0:1788940352.629307:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788940352.629315:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18416f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+17:5858:x1875839738219264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788940352.629698:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18416f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+17:5858:x1875839738219264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 382us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940352.629706:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788940352.629749:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198183100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738219264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788940352.629782:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198183100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738219392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788940352.629826:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940352.629854:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1b0ca0480 going to sleep for 11 seconds 00000100:00100000:2.0:1788940352.629866:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738219392 00000100:00100000:2.0:1788940352.629870:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738219392 00000100:00100000:2.0:1788940352.629891:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788940352.629897:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18416ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+17:5858:x1875839738219392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788940352.630056:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18416ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+17:5858:x1875839738219392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 158us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940352.630064:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788940352.630102:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198183100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738219392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788940352.630319:0:8589:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198183100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:8589:1875839738219520:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788940352.630359:0:8589:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940352.630378:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738219520 00000100:00100000:2.0:1788940352.630382:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738219520 00000100:00100000:2.0:1788940352.630404:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788940352.630410:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18416dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+17:8589:x1875839738219520:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788940352.630566:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18416dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+17:8589:x1875839738219520:12345-0@lo:502:llog_process_th.0 Request processed in 156us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940352.630573:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788940352.630608:0:8589:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1b0ca0480 going to sleep for 11 seconds 00000100:00100000:2.0:1788940352.630620:0:8589:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198183100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:8589:1875839738219520:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788940352.630644:0:8589:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788940352.630656:0:8589:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940352.630659:0:8589:0:(obd_config.c:1662:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788940352.630668:0:8589:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: general-ffff89f1bf721000 00000020:00000080:2.0:1788940352.630670:0:8589:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788940352.634656:0:8589:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b48a7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:8589:1875839738219648:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788940352.634771:0:8589:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940352.634816:0:8589:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1baa6a780 going to sleep for 11 seconds 00000100:00100000:2.0:1788940352.637458:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738219648 00000100:00100000:2.0:1788940352.637487:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738219648 00000100:00100000:2.0:1788940352.637599:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788940352.637611:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18416c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+17:8589:x1875839738219648:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788940352.637952:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18416c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+17:8589:x1875839738219648:12345-0@lo:502:llog_process_th.0 Request processed in 342us (3180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940352.637960:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788940352.644209:0:8589:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b48a7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:8589:1875839738219648:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788940352.644268:0:8589:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788940352.644280:0:8589:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940352.644283:0:8589:0:(obd_config.c:1662:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788940352.644289:0:8589:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788940352.644402:0:5858:0:(obd_config.c:2244:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788940352.644429:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788940352.644442:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f082ad3c00/0x27a633fcdd4ab3b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4ab42 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940352.644455:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f082ad3c00/0x27a633fcdd4ab3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4ab42 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940352.644467:0:5858:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788940352.644470:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89f19016d800 from 4 10000000:01000000:2.0:1788940352.644473:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788940352.644514:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f181521600/0x27a633fcdd4ab49 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940352.644544:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f181521600/0x27a633fcdd4ab49 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940352.644555:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f181521600/0x27a633fcdd4ab49 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940352.644583:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198183100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738219776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788940352.644659:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940352.644704:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f195ed3240 going to sleep for 11 seconds 00000100:00100000:2.0:1788940352.644743:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738219776 00000100:00100000:2.0:1788940352.644757:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738219776 00000100:00100000:2.0:1788940352.644810:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788940352.644819:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18416e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+17:5858:x1875839738219776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788940352.644835:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940352.644851:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f181520e00/0x27a633fcdd4ab50 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4ab49 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940352.644881:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f181520e00/0x27a633fcdd4ab50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4ab49 expref: 18 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940352.644893:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f181520e00/0x27a633fcdd4ab50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4ab49 expref: 18 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940352.644904:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f181520e00, rc 0) 00000100:00100000:2.0:1788940352.644944:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18416e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+18:5858:x1875839738219776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940352.644951:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788940352.644996:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198183100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738219776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788940352.645011:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f181521600/0x27a633fcdd4ab49 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4ab50 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940352.645021:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f181521600/0x27a633fcdd4ab49 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4ab50 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940352.645067:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198183100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738219904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788940352.645091:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940352.645108:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f195ed3240 going to sleep for 11 seconds 00000100:00100000:2.0:1788940352.645122:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738219904 00000100:00100000:2.0:1788940352.645130:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738219904 00000100:00100000:2.0:1788940352.645153:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788940352.645160:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18416c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+18:5858:x1875839738219904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788940352.645448:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18416c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+18:5858:x1875839738219904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 289us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940352.645456:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788940352.645487:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198183100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738219904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788940352.645513:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198183100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738220032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788940352.645573:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940352.645594:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f195ed3240 going to sleep for 11 seconds 00000100:00100000:2.0:1788940352.645607:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738220032 00000100:00100000:2.0:1788940352.645611:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738220032 00000100:00100000:2.0:1788940352.645632:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788940352.645638:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18416e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+18:5858:x1875839738220032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788940352.650331:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18416e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+18:5858:x1875839738220032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 4677us (4742us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940352.650350:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788940352.654658:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198183100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738220032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788940352.656463:0:8594:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b48a7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:8594:1875839738220160:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788940352.656865:0:8594:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940352.656918:0:8594:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1baa6a240 going to sleep for 11 seconds 00000100:00100000:2.0:1788940352.656986:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738220160 00000100:00100000:2.0:1788940352.656995:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738220160 00000100:00100000:2.0:1788940352.657094:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788940352.657106:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18416fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+18:8594:x1875839738220160:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788940352.657949:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18416fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+18:8594:x1875839738220160:12345-0@lo:502:llog_process_th.0 Request processed in 841us (1081us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940352.657961:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788940352.658606:0:8594:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b48a7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:8594:1875839738220160:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788940352.658763:0:8594:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788940352.658778:0:8594:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940352.658780:0:8594:0:(obd_config.c:1662:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788940352.658787:0:8594:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: general-ffff89f19016d800 00000020:00000080:3.0:1788940352.658790:0:8594:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788940352.658906:0:8594:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b48a7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:8594:1875839738220288:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788940352.658966:0:8594:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940352.659001:0:8594:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1baa6a240 going to sleep for 11 seconds 00000100:00100000:2.0:1788940352.660766:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738220288 00000100:00100000:2.0:1788940352.660781:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738220288 00000100:00100000:2.0:1788940352.660849:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1788940352.660859:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18416d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+18:8594:x1875839738220288:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788940352.661146:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18416d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+18:8594:x1875839738220288:12345-0@lo:502:llog_process_th.0 Request processed in 288us (2180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940352.661155:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788940352.661639:0:8594:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b48a7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:8594:1875839738220288:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788940352.661760:0:8594:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788940352.661770:0:8594:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940352.661773:0:8594:0:(obd_config.c:1662:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788940352.661778:0:8594:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788940352.661852:0:5858:0:(obd_config.c:2244:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788940352.661873:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788940352.661886:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f181521600/0x27a633fcdd4ab49 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4ab50 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940352.661899:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f181521600/0x27a633fcdd4ab49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4ab50 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940352.661913:0:5858:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788940352.661916:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89f188f09000 from 4 10000000:01000000:3.0:1788940352.661919:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788940352.661957:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f1829db400/0x27a633fcdd4ab57 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940352.661967:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f1829db400/0x27a633fcdd4ab57 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940352.661989:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f1829db400/0x27a633fcdd4ab57 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940352.662015:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b48a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738220416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788940352.662072:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940352.662113:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1baa6a240 going to sleep for 11 seconds 00000100:00100000:2.0:1788940352.662642:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738220416 00000100:00100000:2.0:1788940352.662649:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738220416 00000100:00100000:2.0:1788940352.662752:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788940352.662763:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18416cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+18:5858:x1875839738220416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788940352.662777:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940352.662810:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f188daa400/0x27a633fcdd4ab5e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4ab57 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940352.662841:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f188daa400/0x27a633fcdd4ab5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4ab57 expref: 19 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940352.662853:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f188daa400/0x27a633fcdd4ab5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4ab57 expref: 19 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940352.662863:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f188daa400, rc 0) 00000100:00100000:2.0:1788940352.662913:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18416cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:5858:x1875839738220416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940352.662920:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788940352.662966:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b48a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738220416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788940352.662981:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f1829db400/0x27a633fcdd4ab57 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4ab5e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940352.662990:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f1829db400/0x27a633fcdd4ab57 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4ab5e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940352.663056:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198183480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738220544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788940352.663082:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940352.663102:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1a977e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940352.663112:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738220544 00000100:00100000:2.0:1788940352.663115:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738220544 00000100:00100000:2.0:1788940352.663135:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788940352.663141:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f188d36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:5858:x1875839738220544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788940352.665939:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f188d36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:5858:x1875839738220544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2783us (2841us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940352.665957:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788940352.666043:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198183480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738220544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788940352.666108:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198183480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738220672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788940352.666164:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940352.666201:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1a977e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940352.666217:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738220672 00000100:00100000:2.0:1788940352.666224:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738220672 00000100:00100000:2.0:1788940352.666263:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1788940352.666272:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f188d37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:5858:x1875839738220672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788940352.666450:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f188d37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:5858:x1875839738220672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 179us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940352.666458:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1788940352.668626:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198183480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738220672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788940352.673024:0:8596:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198183480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:8596:1875839738220800:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788940352.673161:0:8596:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940352.673279:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738220800 00000100:00100000:2.0:1788940352.673287:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738220800 00000100:00100000:2.0:1788940352.673338:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1788940352.673349:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f188d36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:8596:x1875839738220800:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788940352.673846:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f188d36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:8596:x1875839738220800:12345-0@lo:502:llog_process_th.0 Request processed in 497us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940352.673856:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1788940352.673921:0:8596:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1b5090d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788940352.673947:0:8596:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198183480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:8596:1875839738220800:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788940352.673982:0:8596:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788940352.673995:0:8596:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940352.673998:0:8596:0:(obd_config.c:1662:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788940352.674008:0:8596:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: general-ffff89f188f09000 00000020:00000080:2.0:1788940352.674011:0:8596:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788940352.675323:0:8596:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198183480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:8596:1875839738220928:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788940352.675408:0:8596:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940352.675451:0:8596:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1b5090d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788940352.677362:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738220928 00000100:00100000:3.0:1788940352.677381:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738220928 00000100:00100000:3.0:1788940352.677448:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788940352.677460:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1980ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:8596:x1875839738220928:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788940352.680296:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1980ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:8596:x1875839738220928:12345-0@lo:502:llog_process_th.0 Request processed in 2825us (4874us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940352.680313:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1788940352.684566:0:8596:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198183480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:8596:1875839738220928:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788940352.684660:0:8596:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788940352.685151:0:8596:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940352.685155:0:8596:0:(obd_config.c:1662:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788940352.685162:0:8596:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788940352.685252:0:5858:0:(obd_config.c:2244:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788940352.685276:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788940352.685289:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f1829db400/0x27a633fcdd4ab57 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4ab5e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940352.685314:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f1829db400/0x27a633fcdd4ab57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4ab5e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940353.206961:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940354.029211:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198183480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738221056:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788940354.029319:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940354.029565:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738221056 00000100:00100000:3.0:1788940354.029576:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738221056 00000100:00100000:3.0:1788940354.029669:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788940354.029681:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f0821c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738221056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788940354.029740:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788940354.029835:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788940354.036913:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f0821c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738221056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7218us (7577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940354.036933:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1788940354.037211:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f198183480 x1875839738221056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940370 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940354.037245:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198183480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738221056:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788940354.220791:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940355.052801:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198183100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875839738221312:0@lo:400:kworker.0 00000100:00100000:2.0:1788940355.052907:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940355.052969:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bfae8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738221824:0@lo:400:kworker.0 00000100:00100000:2.0:1788940355.052999:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940355.053033:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788940355.053039:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198180a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875839738221440:0@lo:400:kworker.0 00000100:00100000:2.0:1788940355.053061:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940355.053097:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738221312 00000100:00100000:2.0:1788940355.053105:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738221312 00000100:00100000:2.0:1788940355.053150:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738221440 00000100:00100000:2.0:1788940355.053153:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738221440 00000100:00100000:2.0:1788940355.053183:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788940355.053193:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfaeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875839738221312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940355.053249:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfaeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875839738221312:12345-0@lo:400:kworker.0 Request processed in 58us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940355.053256:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788940355.053274:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788940355.053280:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfae9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875839738221440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940355.053303:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfae9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875839738221440:12345-0@lo:400:kworker.0 Request processed in 24us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940355.053309:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788940355.053328:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738221824 00000100:00100000:2.0:1788940355.053338:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738221824 00000100:00100000:2.0:1788940355.053368:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788940355.053374:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfae9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738221824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940355.053404:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfae9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738221824:12345-0@lo:400:kworker.0 Request processed in 31us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940355.053410:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1788940355.053436:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788940355.053441:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940355.053482:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198180a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875839738221440:0@lo:400:kworker.0 00000100:00100000:2.0:1788940355.053494:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198183100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875839738221312:0@lo:400:kworker.0 00010000:00080000:2.0:1788940355.053507:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1bfae8700 x1875839738221824/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940371 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940355.053544:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bfae8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738221824:0@lo:400:kworker.0 00000100:00100000:0.0:1788940355.053715:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198183480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3308:1875839738221184:0@lo:400:kworker.0 00000100:00100000:0.0:1788940355.053758:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940355.053792:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bfae9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875839738221696:0@lo:400:kworker.0 00000100:00100000:0.0:1788940355.053827:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940355.053849:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788940355.053854:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bfae9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738221568:0@lo:400:kworker.0 00000100:00100000:0.0:1788940355.053877:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940355.053905:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738221568 00000100:00100000:0.0:1788940355.053908:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738221568 00000100:00100000:0.0:1788940355.053935:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788940355.053941:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f0821c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738221568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940355.053974:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f0821c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738221568:12345-0@lo:400:kworker.0 Request processed in 34us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940355.053981:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1788940355.054006:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1bfae9180 x1875839738221568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940371 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940355.054016:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bfae9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738221568:0@lo:400:kworker.0 00000100:00100000:0.0:1788940355.054031:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738221696 00000100:00100000:0.0:1788940355.054033:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738221696 00000100:00100000:0.0:1788940355.054058:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788940355.054064:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f0821c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875839738221696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940355.054105:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f0821c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875839738221696:12345-0@lo:400:kworker.0 Request processed in 41us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940355.054112:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1788940355.054129:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788940355.054144:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bfae9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875839738221696:0@lo:400:kworker.0 00000100:00100000:2.0:1788940355.054611:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738221184 00000100:00100000:2.0:1788940355.054617:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738221184 00000100:00100000:2.0:1788940355.054688:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1788940355.054696:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1980dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3308:x1875839738221184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940355.054767:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1980dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3308:x1875839738221184:12345-0@lo:400:kworker.0 Request processed in 72us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940355.054774:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1788940355.056340:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198183480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3308:1875839738221184:0@lo:400:kworker.0 00010000:00010000:0.0:1788940355.252095:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940355.566848:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788940355.566876:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b48a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738221952:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788940355.566942:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940355.568249:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738221952 00000100:00100000:3.0:1788940355.568266:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738221952 00000100:00100000:3.0:1788940355.568350:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788940355.568363:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf555c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738221952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788940355.568439:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788940355.568587:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf555c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738221952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 227us (1643us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940355.568595:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1788940355.568976:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1b48a7b80 x1875839738221952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940371 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940355.569002:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b48a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738221952:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788940356.268922:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940357.118806:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940357.118846:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940357.118893:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940357.118919:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940357.118953:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718267776 00000100:00100000:3.0:1788940357.118965:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718267776 00000100:00100000:3.0:1788940357.119026:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 197 00000100:00100000:3.0:1788940357.119236:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1980de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+10:2352:x1875839718267776:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788940357.119378:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1980de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+10:2352:x1875839718267776:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 342us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940357.119386:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 197 00000100:00100000:2.0:1788940357.119554:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718268032 00000100:00100000:2.0:1788940357.119559:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718268032 00000100:00100000:2.0:1788940357.119604:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718268160 00000100:00100000:2.0:1788940357.119607:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718268160 00000100:00100000:2.0:1788940357.119630:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 21 00000100:00100000:2.0:1788940357.119637:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b48a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+5:2352:x1875839718268032:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788940357.119689:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b48a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+5:2352:x1875839718268032:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 41us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940357.119697:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 21 00000100:00100000:2.0:1788940357.119713:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 22 00000100:00100000:2.0:1788940357.119720:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae852a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+5:2352:x1875839718268160:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788940357.119755:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae852a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+5:2352:x1875839718268160:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 36us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940357.119760:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 22 00000100:00100000:2.0:1788940357.119780:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718267904 00000100:00100000:2.0:1788940357.119783:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718267904 00000100:00100000:2.0:1788940357.119814:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 39 00000100:00100000:2.0:1788940357.119820:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae852d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2352:x1875839718267904:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788940357.119848:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae852d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2352:x1875839718267904:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 28us (954us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940357.119854:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 39 00000100:00080000:2.0:1788940357.119994:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788940357.120000:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788940357.120002:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788940357.293481:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788940358.196553:0:8829:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg214-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1788940358.317114:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940359.149956:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bfae8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738222080:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788940359.150068:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940359.150249:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738222080 00000100:00100000:1.0:1788940359.150261:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738222080 00000100:00100000:1.0:1788940359.150344:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788940359.150356:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f0821c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738222080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788940359.150405:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788940359.150463:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f0821c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738222080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940359.150470:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1788940359.150876:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788940359.150919:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1bfae8700 x1875839738222080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940375 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940359.150944:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bfae8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738222080:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788940359.341448:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940360.172771:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bfaeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738222592:0@lo:400:kworker.0 00000100:00100000:2.0:1788940360.172878:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940360.172955:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788940360.172962:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bfae8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3307:1875839738222208:0@lo:400:kworker.0 00000100:00100000:2.0:1788940360.172996:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940360.173019:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bfaeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875839738222720:0@lo:400:kworker.0 00000100:00100000:2.0:1788940360.173124:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940360.173166:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bfae9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875839738222336:0@lo:400:kworker.0 00000100:00100000:2.0:1788940360.173195:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940360.173215:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bfaebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738222848:0@lo:400:kworker.0 00000100:00100000:2.0:1788940360.173240:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940360.173260:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788940360.173266:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bfae8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875839738222464:0@lo:400:kworker.0 00000100:00100000:2.0:1788940360.173288:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940360.173327:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738222592 00000100:00100000:2.0:1788940360.173336:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738222592 00000100:00100000:2.0:1788940360.173388:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738222848 00000100:00100000:2.0:1788940360.173391:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738222848 00000100:00100000:2.0:1788940360.173428:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788940360.173438:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfaead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738222592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940360.173511:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfaead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738222592:12345-0@lo:400:kworker.0 Request processed in 74us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940360.173552:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788940360.173573:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788940360.173581:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfae8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738222848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940360.173616:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfae8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738222848:12345-0@lo:400:kworker.0 Request processed in 35us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940360.173622:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788940360.173643:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738222208 00000100:00100000:2.0:1788940360.173647:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738222208 00000100:00100000:2.0:1788940360.173683:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1788940360.173689:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1980dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3307:x1875839738222208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940360.173717:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1980dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3307:x1875839738222208:12345-0@lo:400:kworker.0 Request processed in 29us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940360.173731:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1788940360.173760:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738222720 00000100:00100000:2.0:1788940360.173764:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738222720 00000100:00100000:2.0:1788940360.173791:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738222336 00000100:00100000:2.0:1788940360.173794:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738222336 00000100:00100000:2.0:1788940360.173804:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738222464 00000100:00100000:2.0:1788940360.173806:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738222464 00000100:00100000:2.0:1788940360.173821:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788940360.173826:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfaeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875839738222720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940360.173858:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfaeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875839738222720:12345-0@lo:400:kworker.0 Request processed in 32us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940360.173864:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788940360.173876:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788940360.173882:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfaea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875839738222336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940360.173908:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfaea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875839738222336:12345-0@lo:400:kworker.0 Request processed in 26us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940360.173914:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788940360.173927:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788940360.173933:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfaea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875839738222464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940360.173958:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfaea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875839738222464:12345-0@lo:400:kworker.0 Request processed in 25us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940360.173963:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:2.0:1788940360.173999:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788940360.174004:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788940360.174117:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bfae8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875839738222464:0@lo:400:kworker.0 00000100:00100000:2.0:1788940360.174130:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bfae9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875839738222336:0@lo:400:kworker.0 00010000:00080000:2.0:1788940360.174151:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1bfaebb80 x1875839738222848/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940360.174162:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bfaebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738222848:0@lo:400:kworker.0 00000100:00100000:2.0:1788940360.174204:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bfae8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3307:1875839738222208:0@lo:400:kworker.0 00000100:00100000:2.0:1788940360.174215:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bfaeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875839738222720:0@lo:400:kworker.0 00010000:00080000:2.0:1788940360.174225:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1bfaeb100 x1875839738222592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940360.174235:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bfaeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738222592:0@lo:400:kworker.0 00010000:00010000:0.0:1788940360.365107:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940360.688508:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788940360.688568:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae852300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738222976:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788940360.688678:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940360.689044:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738222976 00000100:00100000:1.0:1788940360.689054:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738222976 00000100:00100000:1.0:1788940360.689123:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788940360.689134:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f0821c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738222976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788940360.689181:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788940360.689250:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f0821c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738222976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940360.689258:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1788940360.689420:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1ae852300 x1875839738222976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940376 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940360.689449:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae852300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738222976:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788940361.388754:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940362.253722:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940362.253933:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940362.253965:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940362.254007:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940362.254037:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718268544 00000100:00100000:2.0:1788940362.254049:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718268544 00000100:00100000:2.0:1788940362.256890:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718268672 00000100:00100000:2.0:1788940362.256906:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718268672 00000100:00100000:2.0:1788940362.256950:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 10 00000100:00100000:2.0:1788940362.256962:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfaeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+5:2349:x1875839718268544:12345-192.168.202.14@tcp:9:kworker.0 00000020:00000080:2.0:1788940362.257020:0:6707:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x27a633fcdd4aa9a 00000100:00080000:2.0:1788940362.257032:0:6707:0:(import.c:65:import_set_state_nolock()) ffff89f0841e6800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788940362.257157:0:6707:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788940362.257662:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfaeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+2:2349:x1875839718268544:12345-192.168.202.14@tcp:9:kworker.0 Request processed in 690us (3683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940362.257670:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 10 00000100:00100000:2.0:1788940362.257689:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 11 00000100:00100000:2.0:1788940362.257698:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfae8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+5:2349:x1875839718268672:12345-192.168.202.14@tcp:9:kworker.0 00000020:00000080:2.0:1788940362.257715:0:6707:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x27a633fcdd4aaa1 00000100:00080000:2.0:1788940362.257722:0:6707:0:(import.c:65:import_set_state_nolock()) ffff89f1b4d05800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788940362.258347:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718268288 00000100:00100000:1.0:1788940362.258356:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718268288 00000001:00000004:2.0:1788940362.258427:0:6707:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788940362.266541:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718268416 00000100:00100000:3.0:1788940362.266562:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718268416 00000100:00100000:1.0:1788940362.266728:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 199 00000100:00100000:1.0:1788940362.266756:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1980de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0b05a86-29c8-44a6-9c64-75d9d650043e+10:2353:x1875839718268288:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788940362.266854:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1980de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0b05a86-29c8-44a6-9c64-75d9d650043e+10:2353:x1875839718268288:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 104us (12920us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940362.266862:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 199 00010000:00010000:1.0:1788940362.272130:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788940362.272165:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788940362.272175:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788940362.272178:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788940362.280943:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940362.282598:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 43 00000100:00100000:3.0:1788940362.282621:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfaeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2353:x1875839718268416:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788940362.283895:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfaeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2353:x1875839718268416:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 1273us (30649us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940362.283908:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 43 00000100:00100000:2.0:1788940362.284349:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfae8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+2:2349:x1875839718268672:12345-192.168.202.14@tcp:9:kworker.0 Request processed in 26649us (30338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940362.284360:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 11 00010000:00010000:2.0:1788940362.417881:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940363.443714:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940364.270956:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae850e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738223104:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788940364.271063:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940364.271189:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738223104 00000100:00100000:3.0:1788940364.271197:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738223104 00000100:00100000:3.0:1788940364.271274:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788940364.271285:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f0821c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738223104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788940364.271343:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788940364.271396:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f0821c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738223104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940364.271403:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1788940364.271454:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1ae850e00 x1875839738223104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940380 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940364.271475:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae850e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738223104:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788940364.271556:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788940364.479495:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788940364.851539:0:6732:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9c51ff78-d02d-4e61-8a10-a2f8830f1679 00000020:00000080:0.0:1788940364.851552:0:6732:0:(genops.c:893:class_export_put()) final put ffff89f0841e1000/9c51ff78-d02d-4e61-8a10-a2f8830f1679 00000020:00000080:0.0:1788940364.851584:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff89f0841e1000/9c51ff78-d02d-4e61-8a10-a2f8830f1679 for lustre-OST0000 00000020:00000080:0.0:1788940364.851650:0:37:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff89f0841e6800 for lustre-OST0000 00000100:00100000:1.0:1788940365.295374:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf554a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3308:1875839738223232:0@lo:400:kworker.0 00000100:00100000:1.0:1788940365.295468:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940365.295545:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf556d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875839738223744:0@lo:400:kworker.0 00000100:00100000:1.0:1788940365.295575:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940365.295616:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788940365.295622:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf557b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738223616:0@lo:400:kworker.0 00000100:00100000:1.0:1788940365.295647:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940365.295687:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf557100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875839738223360:0@lo:400:kworker.0 00000100:00100000:1.0:1788940365.295711:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940365.295727:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf556a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738223872:0@lo:400:kworker.0 00000100:00100000:1.0:1788940365.295744:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940365.295759:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788940365.295764:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf557800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875839738223488:0@lo:400:kworker.0 00000100:00100000:1.0:1788940365.295780:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940365.295810:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738223232 00000100:00100000:1.0:1788940365.295817:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738223232 00000100:00100000:1.0:1788940365.295863:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1788940365.295871:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1980dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3308:x1875839738223232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940365.295923:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1980dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3308:x1875839738223232:12345-0@lo:400:kworker.0 Request processed in 52us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940365.295930:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1788940365.295966:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738223744 00000100:00100000:1.0:1788940365.295970:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738223744 00000100:00100000:1.0:1788940365.296009:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738223360 00000100:00100000:1.0:1788940365.296012:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738223360 00000100:00100000:1.0:1788940365.296024:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738223488 00000100:00100000:1.0:1788940365.296027:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738223488 00000100:00100000:1.0:1788940365.296042:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788940365.296048:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf556300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875839738223744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940365.296082:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf556300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875839738223744:12345-0@lo:400:kworker.0 Request processed in 34us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940365.296088:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788940365.296099:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788940365.296105:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf556680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875839738223360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940365.296160:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf556680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875839738223360:12345-0@lo:400:kworker.0 Request processed in 55us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940365.296167:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788940365.296180:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788940365.296187:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf555180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875839738223488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940365.296213:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf555180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875839738223488:12345-0@lo:400:kworker.0 Request processed in 27us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940365.296219:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788940365.296239:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738223616 00000100:00100000:1.0:1788940365.296243:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738223616 00000100:00100000:1.0:1788940365.296268:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738223872 00000100:00100000:1.0:1788940365.296271:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738223872 00000100:00100000:1.0:1788940365.296291:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788940365.296299:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf554e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738223616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940365.296330:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf554e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738223616:12345-0@lo:400:kworker.0 Request processed in 32us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940365.296336:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788940365.296348:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788940365.296354:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf554380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738223872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940365.296382:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf554380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738223872:12345-0@lo:400:kworker.0 Request processed in 28us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940365.296388:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1788940365.296422:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788940365.296427:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940365.296468:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf557800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875839738223488:0@lo:400:kworker.0 00000100:00100000:1.0:1788940365.296479:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf557100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875839738223360:0@lo:400:kworker.0 00010000:00080000:1.0:1788940365.296501:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1bf556a00 x1875839738223872/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940365.296511:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf556a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738223872:0@lo:400:kworker.0 00010000:00080000:1.0:1788940365.296581:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1bf557b80 x1875839738223616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940365.296591:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf557b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738223616:0@lo:400:kworker.0 00000100:00100000:1.0:1788940365.296599:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf554a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3308:1875839738223232:0@lo:400:kworker.0 00000100:00100000:1.0:1788940365.296620:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf556d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875839738223744:0@lo:400:kworker.0 00010000:00010000:2.0:1788940365.488109:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940365.807703:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788940365.807734:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae850e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738224000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788940365.807968:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940365.815465:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738224000 00000100:00100000:3.0:1788940365.815486:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738224000 00000100:00100000:0.0:1788940365.815670:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788940365.815682:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f0821c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738224000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788940365.815733:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788940365.816574:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f0821c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738224000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 890us (8602us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940365.816587:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1788940365.820089:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1ae850e00 x1875839738224000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940381 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940365.820346:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae850e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738224000:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1788940366.439861:0:7662:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9c51ff78-d02d-4e61-8a10-a2f8830f1679 00000020:00000080:1.0:1788940366.439875:0:7662:0:(genops.c:893:class_export_put()) final put ffff89f1b4d03800/9c51ff78-d02d-4e61-8a10-a2f8830f1679 00000020:00000080:1.0:1788940366.439910:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1b4d03800/9c51ff78-d02d-4e61-8a10-a2f8830f1679 for lustre-OST0001 00000020:00000080:1.0:1788940366.439965:0:37:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff89f1b4d05800 for lustre-OST0001 00000001:02000400:3.0:1788940366.491601:0:9074:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg214-server.virtnet: executing yml_node 00010000:00010000:2.0:1788940366.510765:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940367.379478:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940367.380693:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940367.380749:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718268800 00000100:00100000:3.0:1788940367.380761:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718268800 00000100:00100000:3.0:1788940367.380823:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 201 00000100:00100000:3.0:1788940367.380834:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1980dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0b05a86-29c8-44a6-9c64-75d9d650043e+10:2353:x1875839718268800:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788940367.380922:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1980dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0b05a86-29c8-44a6-9c64-75d9d650043e+10:2353:x1875839718268800:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 90us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940367.380930:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 201 00000100:00100000:1.0:1788940367.396259:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718268928 00000100:00100000:1.0:1788940367.396292:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718268928 00000100:00100000:1.0:1788940367.396393:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 47 00000100:00100000:1.0:1788940367.396407:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae852680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2353:x1875839718268928:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788940367.396549:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae852680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2353:x1875839718268928:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 144us (17085us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940367.396557:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 47 00000100:00080000:2.0:1788940367.413579:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788940367.536768:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940368.556954:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940369.389331:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae850380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738224128:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788940369.389439:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940369.390237:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738224128 00000100:00100000:3.0:1788940369.390249:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738224128 00000100:00080000:2.0:1788940369.390352:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788940369.394305:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788940369.394338:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf556d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738224128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788940369.394393:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788940369.394513:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf556d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738224128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 194us (5074us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940369.394581:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1788940369.394702:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1ae850380 x1875839738224128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940385 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940369.394740:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae850380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738224128:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788940369.584796:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940370.422166:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875839738224384:0@lo:400:kworker.0 00000100:00100000:1.0:1788940370.422241:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738224640:0@lo:400:kworker.0 00000100:00100000:2.0:1788940370.422270:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940370.422301:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940370.422354:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b55aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738224896:0@lo:400:kworker.0 00000100:00100000:2.0:1788940370.422390:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875839738224512:0@lo:400:kworker.0 00000100:00100000:2.0:1788940370.422418:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940370.422428:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788940370.422438:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3307:1875839738224256:0@lo:400:kworker.0 00000100:00100000:2.0:1788940370.422465:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940370.422474:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940370.422514:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875839738224768:0@lo:400:kworker.0 00000100:00100000:2.0:1788940370.422573:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738224640 00000100:00100000:2.0:1788940370.422582:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738224640 00000100:00100000:2.0:1788940370.422634:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738224896 00000100:00100000:2.0:1788940370.422637:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738224896 00000100:00100000:2.0:1788940370.422686:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788940370.422698:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf554a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738224640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940370.422760:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf554a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738224640:12345-0@lo:400:kworker.0 Request processed in 63us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940370.422768:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788940370.422788:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788940370.422794:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfae8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738224896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940370.422828:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfae8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738224896:12345-0@lo:400:kworker.0 Request processed in 34us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940370.422834:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788940370.422856:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738224384 00000100:00100000:2.0:1788940370.422859:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738224384 00000100:00100000:1.0:1788940370.423272:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940370.439102:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738224512 00000100:00100000:2.0:1788940370.439133:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738224512 00000100:00100000:1.0:1788940370.439148:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738224768 00000100:00100000:1.0:1788940370.439155:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738224768 00000100:00100000:1.0:1788940370.439204:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788940370.439215:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788940370.439217:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfaebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875839738224384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940370.439230:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfae9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875839738224512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940370.443419:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfae9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875839738224512:12345-0@lo:400:kworker.0 Request processed in 4179us (20984us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940370.443441:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788940370.443504:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788940370.443536:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf557b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875839738224768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940370.443622:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf557b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875839738224768:12345-0@lo:400:kworker.0 Request processed in 109us (20350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940370.443630:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1788940370.443680:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788940370.443687:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788940370.443737:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875839738224512:0@lo:400:kworker.0 00010000:00080000:2.0:1788940370.443803:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1b55aad80 x1875839738224896/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940370.443827:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b55aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738224896:0@lo:400:kworker.0 00000100:00100000:2.0:1788940370.444147:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738224256 00000100:00100000:2.0:1788940370.444156:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738224256 00000100:00100000:2.0:1788940370.444205:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1788940370.444214:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1980dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3307:x1875839738224256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940370.444261:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1980dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3307:x1875839738224256:12345-0@lo:400:kworker.0 Request processed in 49us (21788us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940370.444267:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1788940370.444481:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875839738224768:0@lo:400:kworker.0 00010000:00080000:0.0:1788940370.444500:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f0821c1880 x1875839738224640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940370.444510:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738224640:0@lo:400:kworker.0 00000100:00100000:0.0:1788940370.444572:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3307:1875839738224256:0@lo:400:kworker.0 00000100:00100000:1.0:1788940370.445125:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfaebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875839738224384:12345-0@lo:400:kworker.0 Request processed in 5909us (22853us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940370.445203:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788940370.446137:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875839738224384:0@lo:400:kworker.0 00010000:00010000:2.0:1788940370.606570:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940370.925593:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788940370.925624:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae851180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738225024:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788940370.925718:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940370.925796:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738225024 00000100:00100000:3.0:1788940370.925806:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738225024 00000100:00100000:3.0:1788940370.925860:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788940370.925870:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae851500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738225024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788940370.925914:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788940370.925963:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae851500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738225024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940370.925970:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1788940370.927162:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1ae851180 x1875839738225024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940386 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940370.927190:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae851180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738225024:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1788940371.302870:0:9265:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.2 00010000:00010000:2.0:1788940371.628823:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940372.476555:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940372.476603:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940372.476628:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718269184 00000100:00100000:3.0:1788940372.476640:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718269184 00000100:00100000:3.0:1788940372.476721:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 51 00000100:00100000:3.0:1788940372.476732:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae851180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2353:x1875839718269184:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788940372.476813:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae851180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2353:x1875839718269184:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 83us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940372.476819:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 51 00000100:00100000:3.0:1788940372.476851:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718269056 00000100:00100000:3.0:1788940372.476871:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718269056 00000100:00100000:3.0:1788940372.476896:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 203 00000100:00100000:3.0:1788940372.476902:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1980dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+10:2353:x1875839718269056:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788940372.476926:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1980dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+10:2353:x1875839718269056:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 25us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940372.476932:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 203 00000100:00080000:3.0:1788940372.476958:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788940372.652808:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940373.684795:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788940374.146130:0:9363:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.2 00000100:00100000:1.0:1788940374.510740:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788940374.510766:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae850700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738225152:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788940374.510842:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940374.511358:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738225152 00000100:00100000:3.0:1788940374.511368:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738225152 00000100:00100000:3.0:1788940374.511439:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788940374.511450:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf556a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738225152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788940374.511499:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788940374.511586:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf556a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738225152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 137us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940374.511594:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1788940374.511853:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1ae850700 x1875839738225152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940390 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940374.511874:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae850700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738225152:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788940374.512734:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788940374.705415:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940375.534929:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae850000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738225664:0@lo:400:kworker.0 00000100:00100000:0.0:1788940375.535011:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940375.535085:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788940375.535090:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae853480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3307:1875839738225280:0@lo:400:kworker.0 00000100:00100000:0.0:1788940375.535120:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940375.535144:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae851c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875839738225792:0@lo:400:kworker.0 00000100:00100000:0.0:1788940375.535165:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940375.535188:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae851880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875839738225536:0@lo:400:kworker.0 00000100:00100000:0.0:1788940375.535206:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940375.535240:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788940375.535245:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae851f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875839738225408:0@lo:400:kworker.0 00000100:00100000:0.0:1788940375.535265:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940375.535279:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae850a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738225920:0@lo:400:kworker.0 00000100:00100000:0.0:1788940375.535296:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940375.535321:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738225280 00000100:00100000:0.0:1788940375.535329:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738225280 00000100:00100000:0.0:1788940375.535382:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1788940375.535391:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1980df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3307:x1875839738225280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940375.535437:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1980df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3307:x1875839738225280:12345-0@lo:400:kworker.0 Request processed in 46us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940375.535443:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1788940375.535473:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738225792 00000100:00100000:0.0:1788940375.535476:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738225792 00000100:00100000:0.0:1788940375.535545:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738225536 00000100:00100000:0.0:1788940375.535548:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738225536 00000100:00100000:0.0:1788940375.535564:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738225408 00000100:00100000:0.0:1788940375.535566:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738225408 00000100:00100000:0.0:1788940375.535577:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788940375.535583:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b55aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875839738225792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940375.535616:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b55aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875839738225792:12345-0@lo:400:kworker.0 Request processed in 33us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940375.535622:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788940375.535633:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788940375.535639:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b55a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875839738225536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940375.535670:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b55a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875839738225536:12345-0@lo:400:kworker.0 Request processed in 32us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940375.535686:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788940375.535698:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788940375.535703:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b55aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875839738225408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940375.535730:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b55aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875839738225408:12345-0@lo:400:kworker.0 Request processed in 27us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940375.535736:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788940375.535764:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738225664 00000100:00100000:0.0:1788940375.535767:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738225664 00000100:00100000:0.0:1788940375.535787:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738225920 00000100:00100000:0.0:1788940375.535790:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738225920 00000100:00100000:0.0:1788940375.535807:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788940375.535812:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b55aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738225664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940375.535842:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b55aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738225664:12345-0@lo:400:kworker.0 Request processed in 31us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940375.535849:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788940375.535858:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788940375.535863:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b55a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738225920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940375.535886:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b55a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738225920:12345-0@lo:400:kworker.0 Request processed in 23us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940375.535891:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1788940375.535909:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788940375.535914:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788940375.535943:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae851f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875839738225408:0@lo:400:kworker.0 00010000:00080000:0.0:1788940375.535957:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1ae850a80 x1875839738225920/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940391 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940375.535966:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae850a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738225920:0@lo:400:kworker.0 00000100:00100000:0.0:1788940375.535982:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae851880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875839738225536:0@lo:400:kworker.0 00000100:00100000:0.0:1788940375.536008:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae853480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3307:1875839738225280:0@lo:400:kworker.0 00000100:00100000:0.0:1788940375.536016:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae851c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875839738225792:0@lo:400:kworker.0 00010000:00080000:0.0:1788940375.536024:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1ae850000 x1875839738225664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940391 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940375.536032:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae850000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738225664:0@lo:400:kworker.0 00010000:00010000:2.0:1788940375.724913:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940376.044685:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788940376.044708:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae853100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738226048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788940376.044794:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940376.044872:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738226048 00000100:00100000:3.0:1788940376.044882:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738226048 00000100:00100000:3.0:1788940376.044934:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788940376.044944:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae853800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738226048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788940376.044982:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788940376.045030:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae853800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738226048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940376.045037:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1788940376.045096:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1ae853100 x1875839738226048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940392 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940376.045115:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae853100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738226048:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788940376.749753:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788940376.832051:0:9461:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.2 00000100:00100000:3.0:1788940377.594968:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940377.595022:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940377.595094:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718269440 00000100:00100000:0.0:1788940377.595107:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718269440 00000100:00100000:2.0:1788940377.595167:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718269312 00000100:00100000:2.0:1788940377.595174:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718269312 00000100:00100000:0.0:1788940377.595197:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 55 00000100:00100000:2.0:1788940377.595214:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 205 00000100:00100000:0.0:1788940377.595222:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae853100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2353:x1875839718269440:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788940377.595227:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1980df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0b05a86-29c8-44a6-9c64-75d9d650043e+10:2352:x1875839718269312:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788940377.595308:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1980df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0b05a86-29c8-44a6-9c64-75d9d650043e+10:2352:x1875839718269312:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 85us (350us total) trans 0 rc 0/0 00000100:00080000:3.0:1788940377.595314:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940377.595319:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 205 00000100:00100000:0.0:1788940377.603055:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae853100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2353:x1875839718269440:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 7834us (8018us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940377.603071:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 55 00010000:00010000:2.0:1788940377.780726:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940378.803121:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788940379.156211:0:9509:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Wed Sep 9 03:52:58 EDT 2026 00000100:00100000:1.0:1788940379.629701:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788940379.629725:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bfae8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738226176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788940379.629799:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940379.630407:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738226176 00000100:00100000:2.0:1788940379.630417:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738226176 00000100:00100000:2.0:1788940379.630502:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788940379.630513:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf557100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738226176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788940379.630720:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788940379.630791:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf557100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738226176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 279us (992us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940379.630798:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1788940379.630898:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1bfae8380 x1875839738226176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940395 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940379.630920:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bfae8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738226176:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788940379.631011:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788940379.821108:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940380.653083:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788940380.653112:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b55a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875839738226432:0@lo:400:kworker.0 00000100:00100000:0.0:1788940380.653192:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940380.653268:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738226432 00000100:00100000:0.0:1788940380.653278:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738226432 00000100:00100000:0.0:1788940380.653337:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788940380.653348:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b55a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875839738226432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940380.653426:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b55a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875839738226432:12345-0@lo:400:kworker.0 Request processed in 79us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940380.653434:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788940380.653492:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b55a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875839738226432:0@lo:400:kworker.0 00000100:00100000:0.0:1788940380.653554:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b55a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875839738226560:0@lo:400:kworker.0 00000100:00100000:0.0:1788940380.653704:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940380.653770:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b55a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738226944:0@lo:400:kworker.0 00000100:00100000:0.0:1788940380.653795:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940380.653820:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738226944 00000100:00100000:0.0:1788940380.653824:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738226944 00000100:00100000:0.0:1788940380.653858:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788940380.653863:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b55a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738226944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940380.653894:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b55a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738226944:12345-0@lo:400:kworker.0 Request processed in 31us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940380.653900:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1788940380.653915:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788940380.653937:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1b55a8000 x1875839738226944/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940380.653947:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b55a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738226944:0@lo:400:kworker.0 00000100:00100000:3.0:1788940380.654008:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738226560 00000100:00100000:3.0:1788940380.654013:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738226560 00000100:00100000:3.0:1788940380.654051:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788940380.654058:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b55ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875839738226560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940380.654094:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b55ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875839738226560:12345-0@lo:400:kworker.0 Request processed in 36us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940380.654100:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:0.0:1788940380.654152:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788940380.654173:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b55a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875839738226560:0@lo:400:kworker.0 00000100:00100000:1.0:1788940380.654251:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b55a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3308:1875839738226304:0@lo:400:kworker.0 00000100:00100000:1.0:1788940380.654289:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940380.654318:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b55a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875839738226816:0@lo:400:kworker.0 00000100:00100000:1.0:1788940380.654337:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940380.654361:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788940380.654366:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b55a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738226688:0@lo:400:kworker.0 00000100:00100000:1.0:1788940380.654386:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940380.654441:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738226816 00000100:00100000:3.0:1788940380.654445:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738226816 00000100:00100000:3.0:1788940380.654490:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788940380.654497:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf557800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875839738226816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940380.654550:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf557800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875839738226816:12345-0@lo:400:kworker.0 Request processed in 54us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940380.654556:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788940380.654592:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b55a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875839738226816:0@lo:400:kworker.0 00000100:00080000:1.0:1788940380.654710:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788940380.654772:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738226304 00000100:00100000:0.0:1788940380.654777:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738226304 00000100:00100000:0.0:1788940380.654806:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1788940380.654812:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1980dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3308:x1875839738226304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940380.654949:0:7074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738226688 00000100:00100000:2.0:1788940380.654954:0:7074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738226688 00000100:00100000:2.0:1788940380.654981:0:7074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788940380.654988:0:7074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf554000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738226688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940380.655091:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1980dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3308:x1875839738226304:12345-0@lo:400:kworker.0 Request processed in 277us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940380.655098:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1788940380.662276:0:7074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf554000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738226688:12345-0@lo:400:kworker.0 Request processed in 7276us (7876us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940380.662294:0:7074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788940380.672106:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b55a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3308:1875839738226304:0@lo:400:kworker.0 00010000:00080000:2.0:1788940380.672784:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1b55a9f80 x1875839738226688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940380.672800:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b55a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738226688:0@lo:400:kworker.0 00010000:00010000:2.0:1788940380.849509:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940381.164956:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788940381.164982:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae853b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738227072:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788940381.165064:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940381.165178:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738227072 00000100:00100000:3.0:1788940381.165188:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738227072 00000100:00100000:3.0:1788940381.165253:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788940381.165265:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf555f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738227072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788940381.165323:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788940381.165384:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf555f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738227072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940381.165392:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1788940381.165513:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1ae853b80 x1875839738227072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940397 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940381.165565:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae853b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738227072:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788940381.869951:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940382.715031:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940382.715078:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940382.715121:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718269568 00000100:00100000:0.0:1788940382.715134:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718269568 00000100:00100000:0.0:1788940382.715189:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 207 00000100:00100000:0.0:1788940382.715201:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1980dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0b05a86-29c8-44a6-9c64-75d9d650043e+10:2353:x1875839718269568:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788940382.715274:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1980dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0b05a86-29c8-44a6-9c64-75d9d650043e+10:2353:x1875839718269568:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 75us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940382.715283:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 207 00000100:00100000:3.0:1788940382.715412:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718269696 00000100:00100000:3.0:1788940382.715417:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718269696 00000100:00100000:3.0:1788940382.715480:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 59 00000100:00100000:3.0:1788940382.715500:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b55a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2353:x1875839718269696:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788940382.715590:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b55a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2353:x1875839718269696:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 91us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940382.715597:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 59 00000100:00080000:0.0:1788940382.716003:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788940382.898844:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940383.925633:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940384.748996:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788940384.749022:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bfae8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738227200:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788940384.749098:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940384.749291:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738227200 00000100:00100000:2.0:1788940384.749301:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738227200 00000100:00100000:2.0:1788940384.749386:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788940384.749398:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae853b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738227200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788940384.749450:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788940384.749543:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae853b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738227200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940384.749551:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1788940384.749716:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1bfae8380 x1875839738227200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940400 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940384.749735:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bfae8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738227200:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788940384.750044:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788940384.940843:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940385.773601:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae851c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875839738227456:0@lo:400:kworker.0 00000100:00100000:3.0:1788940385.773677:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940385.773738:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae851f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738227968:0@lo:400:kworker.0 00000100:00100000:3.0:1788940385.773765:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940385.773796:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788940385.773802:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae853480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875839738227584:0@lo:400:kworker.0 00000100:00100000:3.0:1788940385.773821:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940385.773864:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738227456 00000100:00100000:3.0:1788940385.773872:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738227456 00000100:00100000:3.0:1788940385.773918:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738227584 00000100:00100000:3.0:1788940385.773921:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738227584 00000100:00100000:3.0:1788940385.773952:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788940385.773961:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae850700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875839738227456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940385.774018:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae850700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875839738227456:12345-0@lo:400:kworker.0 Request processed in 58us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940385.774025:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788940385.774042:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788940385.774048:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae850e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875839738227584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940385.774073:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae850e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875839738227584:12345-0@lo:400:kworker.0 Request processed in 25us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940385.774078:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788940385.774111:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738227968 00000100:00100000:3.0:1788940385.774116:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738227968 00000100:00100000:3.0:1788940385.774142:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788940385.774148:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae850380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738227968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940385.774178:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae850380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738227968:12345-0@lo:400:kworker.0 Request processed in 29us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940385.774184:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1788940385.774206:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788940385.774211:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788940385.774244:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae853480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875839738227584:0@lo:400:kworker.0 00000100:00100000:3.0:1788940385.774254:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae851c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875839738227456:0@lo:400:kworker.0 00010000:00080000:3.0:1788940385.774266:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1ae851f80 x1875839738227968/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940401 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940385.774287:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae851f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738227968:0@lo:400:kworker.0 00000100:00100000:1.0:1788940385.774637:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae850000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3308:1875839738227328:0@lo:400:kworker.0 00000100:00100000:1.0:1788940385.774676:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940385.774708:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae850a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875839738227840:0@lo:400:kworker.0 00000100:00100000:1.0:1788940385.774732:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940385.774749:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788940385.774755:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae851880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738227712:0@lo:400:kworker.0 00000100:00100000:1.0:1788940385.774776:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940385.775088:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738227328 00000100:00100000:3.0:1788940385.775104:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738227328 00000100:00100000:3.0:1788940385.775147:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1788940385.775156:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1980de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3308:x1875839738227328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940385.775202:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1980de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3308:x1875839738227328:12345-0@lo:400:kworker.0 Request processed in 47us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940385.775209:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1788940385.775240:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738227712 00000100:00100000:3.0:1788940385.775243:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738227712 00000100:00100000:3.0:1788940385.775267:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788940385.775274:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf554700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738227712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940385.775303:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf554700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738227712:12345-0@lo:400:kworker.0 Request processed in 30us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940385.775309:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1788940385.775338:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1ae851880 x1875839738227712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940401 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940385.775350:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae851880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738227712:0@lo:400:kworker.0 00000100:00100000:3.0:1788940385.775359:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae850000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3308:1875839738227328:0@lo:400:kworker.0 00000100:00100000:3.0:1788940385.775380:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738227840 00000100:00100000:3.0:1788940385.775383:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738227840 00000100:00100000:3.0:1788940385.775409:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788940385.775428:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf557480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875839738227840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940385.775461:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf557480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875839738227840:12345-0@lo:400:kworker.0 Request processed in 34us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940385.775472:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:3.0:1788940385.775491:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788940385.775511:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae850a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875839738227840:0@lo:400:kworker.0 00010000:00010000:2.0:1788940385.966126:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940386.285904:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788940386.286752:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae850a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738228096:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788940386.286829:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940386.297458:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738228096 00000100:00100000:3.0:1788940386.297478:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738228096 00000100:00100000:3.0:1788940386.297589:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788940386.297602:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfae8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738228096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788940386.297649:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788940386.297745:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfae8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738228096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 146us (10915us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940386.297752:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1788940386.297884:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1ae850a80 x1875839738228096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940402 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940386.297907:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae850a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738228096:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788940386.989093:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940387.841689:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940387.841739:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940387.841859:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718269952 00000100:00100000:0.0:1788940387.841876:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718269952 00000100:00100000:0.0:1788940387.841963:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 63 00000100:00100000:0.0:1788940387.841975:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2353:x1875839718269952:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788940387.842059:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2353:x1875839718269952:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 87us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940387.842080:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 63 00000100:00080000:0.0:1788940387.842105:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940387.842830:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718269824 00000100:00100000:2.0:1788940387.842837:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718269824 00000100:00100000:2.0:1788940387.842896:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 209 00000100:00100000:2.0:1788940387.842906:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1980df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0b05a86-29c8-44a6-9c64-75d9d650043e+10:2353:x1875839718269824:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788940387.843049:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1980df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0b05a86-29c8-44a6-9c64-75d9d650043e+10:2353:x1875839718269824:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 144us (1308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940387.843056:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 209 00010000:00010000:2.0:1788940388.013431:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940389.037932:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940389.871878:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bfae9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738228224:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788940389.871955:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940389.872031:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738228224 00000100:00100000:3.0:1788940389.872041:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738228224 00000100:00100000:3.0:1788940389.872110:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788940389.872120:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae851880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738228224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788940389.872163:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788940389.872211:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae851880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738228224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940389.872218:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1788940389.872270:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1bfae9500 x1875839738228224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940405 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940389.872314:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bfae9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738228224:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788940389.880129:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788940390.063818:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940390.900578:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738228736:0@lo:400:kworker.0 00000100:00100000:2.0:1788940390.900654:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940390.900709:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788940390.900728:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bfae9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3307:1875839738228352:0@lo:400:kworker.0 00000100:00100000:2.0:1788940390.900755:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940390.900773:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875839738228864:0@lo:400:kworker.0 00000100:00100000:2.0:1788940390.900793:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940390.901064:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738228352 00000100:00100000:1.0:1788940390.901074:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738228352 00000100:00100000:1.0:1788940390.901131:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1788940390.901140:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1980dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3307:x1875839738228352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940390.901197:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1980dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3307:x1875839738228352:12345-0@lo:400:kworker.0 Request processed in 57us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940390.901204:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1788940390.901255:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bfae9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3307:1875839738228352:0@lo:400:kworker.0 00000100:00100000:2.0:1788940390.903224:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bfae9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875839738228480:0@lo:400:kworker.0 00000100:00100000:2.0:1788940390.903658:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940390.903797:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738228992:0@lo:400:kworker.0 00000100:00100000:2.0:1788940390.903847:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940390.903884:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788940390.903892:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bfae8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875839738228608:0@lo:400:kworker.0 00000100:00100000:2.0:1788940390.903914:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940390.903961:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738228736 00000100:00100000:0.0:1788940390.903971:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738228736 00000100:00100000:0.0:1788940390.904025:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738228992 00000100:00100000:0.0:1788940390.904029:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738228992 00000100:00100000:0.0:1788940390.904080:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788940390.904090:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f0821c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738228736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940390.904173:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f0821c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738228736:12345-0@lo:400:kworker.0 Request processed in 85us (3519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940390.904181:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788940390.904200:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788940390.904208:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f198183100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738228992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940390.904308:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f198183100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738228992:12345-0@lo:400:kworker.0 Request processed in 101us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940390.904314:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1788940390.915763:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f0821c1880 x1875839738228992/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940406 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940390.915783:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738228992:0@lo:400:kworker.0 00000100:00080000:0.0:1788940390.916045:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788940390.919838:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f0821c1500 x1875839738228736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940406 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940390.919858:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738228736:0@lo:400:kworker.0 00000100:00100000:1.0:1788940390.921085:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738228864 00000100:00100000:1.0:1788940390.921100:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738228864 00000100:00100000:1.0:1788940390.921190:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738228480 00000100:00100000:1.0:1788940390.921194:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738228480 00000100:00100000:1.0:1788940390.921209:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738228608 00000100:00100000:1.0:1788940390.921211:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738228608 00000100:00100000:1.0:1788940390.921230:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788940390.921240:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f0821c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875839738228864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940390.921335:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f0821c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875839738228864:12345-0@lo:400:kworker.0 Request processed in 96us (20540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940390.921343:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788940390.921392:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875839738228864:0@lo:400:kworker.0 00000100:00100000:1.0:1788940390.921420:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788940390.921426:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f198183480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875839738228480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940390.921463:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f198183480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875839738228480:12345-0@lo:400:kworker.0 Request processed in 38us (17808us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940390.921468:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788940390.921479:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788940390.921486:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f198180a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875839738228608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940390.921560:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f198180a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875839738228608:12345-0@lo:400:kworker.0 Request processed in 75us (17645us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940390.921567:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:0.0:1788940390.922280:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940390.923175:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bfae8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875839738228608:0@lo:400:kworker.0 00000100:00100000:2.0:1788940390.923193:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bfae9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875839738228480:0@lo:400:kworker.0 00010000:00010000:2.0:1788940391.085547:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940391.413853:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae851f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738229120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788940391.413924:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940391.414001:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738229120 00000100:00100000:3.0:1788940391.414010:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738229120 00000100:00100000:3.0:1788940391.414381:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788940391.414393:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae851c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738229120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788940391.414436:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788940391.414497:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae851c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738229120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940391.414504:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1788940391.414613:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1ae851f80 x1875839738229120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940407 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940391.414633:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae851f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738229120:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788940392.110785:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940392.952638:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940392.952704:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940392.953069:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718270208 00000100:00100000:3.0:1788940392.953082:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718270208 00000100:00100000:3.0:1788940392.953176:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 67 00000100:00100000:3.0:1788940392.953190:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b55a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2350:x1875839718270208:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788940392.953420:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b55a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2350:x1875839718270208:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 231us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940392.953428:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 67 00000100:00100000:3.0:1788940392.953459:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718270080 00000100:00100000:3.0:1788940392.953463:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718270080 00000100:00100000:3.0:1788940392.953500:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 211 00000100:00100000:3.0:1788940392.953507:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18415cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+10:2350:x1875839718270080:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788940392.953562:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18415cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+10:2350:x1875839718270080:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 55us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940392.953586:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 211 00000100:00080000:0.0:1788940392.955944:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788940393.146870:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940394.156851:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940394.988931:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae853480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738229248:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788940394.989030:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940394.989122:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738229248 00000100:00100000:3.0:1788940394.989132:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738229248 00000100:00100000:3.0:1788940394.991100:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788940394.991118:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae852300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738229248:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788940394.992500:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1788940394.998797:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788940394.999100:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae852300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738229248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7983us (10065us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940394.999114:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1788940394.999185:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1ae853480 x1875839738229248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940410 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940394.999226:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae853480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738229248:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788940395.181547:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940396.044433:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae853480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3308:1875839738229376:0@lo:400:kworker.0 00000100:00100000:3.0:1788940396.045161:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940396.045294:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738229376 00000100:00100000:3.0:1788940396.045305:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738229376 00000100:00100000:3.0:1788940396.045367:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1788940396.045378:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18415d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3308:x1875839738229376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940396.045438:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18415d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3308:x1875839738229376:12345-0@lo:400:kworker.0 Request processed in 61us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940396.045446:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1788940396.045608:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae853480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3308:1875839738229376:0@lo:400:kworker.0 00000100:00100000:3.0:1788940396.045659:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae853480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875839738229504:0@lo:400:kworker.0 00000100:00100000:3.0:1788940396.045709:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940396.045743:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738229504 00000100:00100000:3.0:1788940396.045747:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738229504 00000100:00100000:3.0:1788940396.045776:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788940396.045783:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae851f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875839738229504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940396.045821:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae851f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875839738229504:12345-0@lo:400:kworker.0 Request processed in 38us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940396.045827:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788940396.045855:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae853480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875839738229504:0@lo:400:kworker.0 00000100:00100000:3.0:1788940396.045883:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788940396.045889:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae853480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875839738229632:0@lo:400:kworker.0 00000100:00100000:3.0:1788940396.045911:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940396.045934:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738229632 00000100:00100000:3.0:1788940396.045937:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738229632 00000100:00100000:3.0:1788940396.045967:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788940396.045973:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae850a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875839738229632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940396.046005:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae850a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875839738229632:12345-0@lo:400:kworker.0 Request processed in 32us (93us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940396.046011:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788940396.046038:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae853480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875839738229632:0@lo:400:kworker.0 00000100:00080000:2.0:1788940396.047602:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940396.049725:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae853480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738229760:0@lo:400:kworker.0 00000100:00100000:2.0:1788940396.050199:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940396.050263:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738229760 00000100:00100000:2.0:1788940396.050273:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738229760 00000100:00100000:2.0:1788940396.050344:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788940396.050354:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f0821c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738229760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940396.050415:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f0821c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738229760:12345-0@lo:400:kworker.0 Request processed in 63us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940396.050424:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1788940396.050448:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788940396.050481:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1ae853480 x1875839738229760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940396.050496:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae853480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738229760:0@lo:400:kworker.0 00000100:00100000:3.0:1788940396.056418:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f184194700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738230016:0@lo:400:kworker.0 00000100:00100000:3.0:1788940396.056500:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940396.057213:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738230016 00000100:00100000:2.0:1788940396.057225:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738230016 00000100:00100000:2.0:1788940396.057300:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788940396.057310:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f184197480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738230016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940396.057386:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f184197480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738230016:12345-0@lo:400:kworker.0 Request processed in 77us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940396.057391:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788940396.057414:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788940396.057425:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae853480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875839738229888:0@lo:400:kworker.0 00000100:00100000:2.0:1788940396.057452:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940396.057480:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738229888 00000100:00100000:2.0:1788940396.057484:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738229888 00000100:00100000:2.0:1788940396.057515:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788940396.057535:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f0821c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875839738229888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940396.057714:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f0821c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875839738229888:12345-0@lo:400:kworker.0 Request processed in 179us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940396.057721:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788940396.057935:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae853480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875839738229888:0@lo:400:kworker.0 00010000:00080000:2.0:1788940396.057974:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f184194700 x1875839738230016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940396.057985:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f184194700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738230016:0@lo:400:kworker.0 00000100:00080000:1.0:1788940396.058201:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788940396.058207:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788940396.205094:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940396.525129:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f184195f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738230144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788940396.525211:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940396.525862:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738230144 00000100:00100000:3.0:1788940396.525885:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738230144 00000100:00100000:3.0:1788940396.525946:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788940396.525956:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f0821c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738230144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788940396.525992:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788940396.526048:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f0821c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738230144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940396.526055:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1788940396.527144:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f184195f80 x1875839738230144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940412 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940396.527166:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f184195f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738230144:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788940397.228873:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940398.073151:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940398.073234:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940398.073339:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718270336 00000100:00100000:1.0:1788940398.073355:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718270336 00000100:00100000:1.0:1788940398.073442:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 213 00000100:00100000:1.0:1788940398.073455:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18415f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0b05a86-29c8-44a6-9c64-75d9d650043e+10:2350:x1875839718270336:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788940398.073551:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18415f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0b05a86-29c8-44a6-9c64-75d9d650043e+10:2350:x1875839718270336:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 99us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940398.073559:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 213 00000100:00100000:3.0:1788940398.073700:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718270464 00000100:00100000:3.0:1788940398.073706:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718270464 00000100:00100000:3.0:1788940398.073795:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 71 00000100:00100000:3.0:1788940398.073804:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b55a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2350:x1875839718270464:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788940398.073907:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b55a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2350:x1875839718270464:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 58us (718us total) trans 0 rc 0/0 00000100:00080000:1.0:1788940398.073907:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788940398.073915:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 71 00010000:00010000:3.0:1788940398.258733:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788940398.877276:0:10143:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 03:53:18 (1788940398) === 00010000:00010000:1.0:1788940399.277189:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940399.382688:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940399.383722:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718270592 00000100:00100000:1.0:1788940399.383739:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718270592 00000100:00100000:1.0:1788940399.383822:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 214 00000100:00100000:1.0:1788940399.383835:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18415f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+10:8137:x1875839718270592:12345-192.168.202.14@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788940399.383859:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940399.383883:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f19258c800/0x27a633fcdd4ab65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f56bd expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940399.383924:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f19258c800/0x27a633fcdd4ab65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f56bd expref: 11 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940399.383937:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f19258c800/0x27a633fcdd4ab65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f56bd expref: 11 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940399.383970:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f19258c800, rc 0) 00000100:00100000:1.0:1788940399.384056:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18415f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+11:8137:x1875839718270592:12345-192.168.202.14@tcp:101:mount.lustre.0 Request processed in 223us (1381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940399.384064:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 214 00000100:00100000:2.0:1788940399.397947:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940399.398292:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718270720 00000100:00100000:1.0:1788940399.398307:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718270720 00000100:00100000:1.0:1788940399.398387:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 215 00000100:00100000:1.0:1788940399.398399:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18415d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0b05a86-29c8-44a6-9c64-75d9d650043e+11:8137:x1875839718270720:12345-192.168.202.14@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788940399.399178:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18415d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0b05a86-29c8-44a6-9c64-75d9d650043e+11:8137:x1875839718270720:12345-192.168.202.14@tcp:501:mount.lustre.0 Request processed in 776us (1240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940399.399191:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 215 00000100:00100000:0.0:1788940399.417768:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940399.417997:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718270848 00000100:00100000:1.0:1788940399.418012:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718270848 00000100:00100000:1.0:1788940399.418092:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 216 00000100:00100000:1.0:1788940399.418273:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18415c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+11:8137:x1875839718270848:12345-192.168.202.14@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788940399.418667:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18415c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+11:8137:x1875839718270848:12345-192.168.202.14@tcp:503:mount.lustre.0 Request processed in 562us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940399.418677:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 216 00000100:00100000:3.0:1788940399.422626:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940399.422937:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718270976 00000100:00100000:0.0:1788940399.422951:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718270976 00000100:00100000:0.0:1788940399.423017:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 217 00000100:00100000:0.0:1788940399.423027:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18415e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0b05a86-29c8-44a6-9c64-75d9d650043e+11:8141:x1875839718270976:12345-192.168.202.14@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788940399.423971:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18415e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0b05a86-29c8-44a6-9c64-75d9d650043e+11:8141:x1875839718270976:12345-192.168.202.14@tcp:502:llog_process_th.0 Request processed in 938us (1355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940399.423983:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 217 00000100:00100000:2.0:1788940399.463961:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940399.464149:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718271104 00000100:00100000:1.0:1788940399.464162:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718271104 00000100:00100000:1.0:1788940399.464218:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 218 00000100:00100000:1.0:1788940399.464229:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18415f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+11:8141:x1875839718271104:12345-192.168.202.14@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788940399.464850:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18415f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+11:8141:x1875839718271104:12345-192.168.202.14@tcp:502:llog_process_th.0 Request processed in 621us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940399.464867:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 218 00000100:00100000:1.0:1788940399.485359:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940399.487317:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718271232 00000100:00100000:0.0:1788940399.487347:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718271232 00000100:00100000:0.0:1788940399.487447:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 219 00000100:00100000:0.0:1788940399.487462:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18415ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0b05a86-29c8-44a6-9c64-75d9d650043e+11:8137:x1875839718271232:12345-192.168.202.14@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788940399.487486:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940399.487513:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f082ad2a00/0x27a633fcdd4ab6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f56e7 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940399.487596:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f082ad2a00/0x27a633fcdd4ab6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f56e7 expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940399.487610:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f082ad2a00/0x27a633fcdd4ab6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f56e7 expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940399.487621:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f082ad2a00, rc 0) 00000100:00100000:0.0:1788940399.488276:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18415ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0b05a86-29c8-44a6-9c64-75d9d650043e+12:8137:x1875839718271232:12345-192.168.202.14@tcp:101:mount.lustre.0 Request processed in 812us (2935us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940399.488296:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 219 00000100:00100000:3.0:1788940399.492841:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940399.493087:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718271360 00000100:00100000:2.0:1788940399.493102:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718271360 00000100:00100000:2.0:1788940399.493188:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 220 00000100:00100000:2.0:1788940399.493201:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18415dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0b05a86-29c8-44a6-9c64-75d9d650043e+12:8137:x1875839718271360:12345-192.168.202.14@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788940399.493237:0:5854:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788940399.493270:0:5854:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788940399.493275:0:5854:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788940399.493278:0:5854:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788940399.493281:0:5854:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1788940399.499197:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18415dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0b05a86-29c8-44a6-9c64-75d9d650043e+12:8137:x1875839718271360:12345-192.168.202.14@tcp:256:mount.lustre.0 Request processed in 5981us (6353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940399.499218:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 220 00000100:00100000:1.0:1788940399.510331:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940399.510581:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718271488 00000100:00100000:3.0:1788940399.510596:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718271488 00000100:00100000:3.0:1788940399.510678:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 221 00000100:00100000:3.0:1788940399.510692:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18415c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+12:8137:x1875839718271488:12345-192.168.202.14@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788940399.510715:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940399.510747:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f1c21f1200/0x27a633fcdd4ab73 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f56ee expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940399.510973:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f1c21f1200/0x27a633fcdd4ab73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f56ee expref: 13 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940399.511000:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f1c21f1200/0x27a633fcdd4ab73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f56ee expref: 13 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940399.511011:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f1c21f1200, rc 0) 00000100:00100000:3.0:1788940399.511146:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18415c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:8137:x1875839718271488:12345-192.168.202.14@tcp:101:mount.lustre.0 Request processed in 456us (832us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940399.511154:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 221 00000100:00100000:3.0:1788940399.514635:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940399.514956:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718271616 00000100:00100000:1.0:1788940399.514969:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718271616 00000100:00100000:1.0:1788940399.515039:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 222 00000100:00100000:1.0:1788940399.515060:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18415e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:8137:x1875839718271616:12345-192.168.202.14@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788940399.515492:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18415e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:8137:x1875839718271616:12345-192.168.202.14@tcp:501:mount.lustre.0 Request processed in 420us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940399.515501:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 222 00000100:00100000:2.0:1788940399.519957:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940399.520072:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718271744 00000100:00100000:3.0:1788940399.520086:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718271744 00000100:00100000:3.0:1788940399.520159:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 223 00000100:00100000:3.0:1788940399.520170:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18415c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:8137:x1875839718271744:12345-192.168.202.14@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788940399.520560:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18415c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:8137:x1875839718271744:12345-192.168.202.14@tcp:503:mount.lustre.0 Request processed in 349us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940399.520570:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 223 00000100:00100000:2.0:1788940399.538168:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940399.538299:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718271872 00000100:00100000:0.0:1788940399.538312:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718271872 00000100:00100000:0.0:1788940399.538383:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 224 00000100:00100000:0.0:1788940399.538396:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18415e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:8144:x1875839718271872:12345-192.168.202.14@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788940399.539150:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18415e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:8144:x1875839718271872:12345-192.168.202.14@tcp:502:llog_process_th.0 Request processed in 752us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940399.539160:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 224 00000100:00100000:0.0:1788940399.554065:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940399.554237:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718272000 00000100:00100000:1.0:1788940399.554250:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718272000 00000100:00100000:1.0:1788940399.554340:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 225 00000100:00100000:1.0:1788940399.554352:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18415fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:8144:x1875839718272000:12345-192.168.202.14@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788940399.554739:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18415fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:8144:x1875839718272000:12345-192.168.202.14@tcp:502:llog_process_th.0 Request processed in 387us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940399.554748:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 225 00000100:00100000:2.0:1788940399.566713:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940399.566854:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718272128 00000100:00100000:3.0:1788940399.567043:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718272128 00000100:00100000:3.0:1788940399.567108:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 10 00000100:00100000:3.0:1788940399.567118:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2349:x1875839718272128:12345-192.168.202.14@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788940399.567160:0:7857:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from ffa310cd-169f-42e3-8999-506116bada08@192.168.202.14@tcp t0 exp 0000000000000000 cur 342 last 0 00000020:00000080:3.0:1788940399.567211:0:7857:0:(genops.c:1393:class_connect()) connect: client ffa310cd-169f-42e3-8999-506116bada08, cookie 0x27a633fcdd4ab7a 00000004:00100000:3.0:1788940399.567263:0:7857:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788940399.567824:0:7857:0:(import.c:65:import_set_state_nolock()) ffff89f192365800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788940399.571644:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940399.571712:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940399.571897:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718272512 00000100:00100000:3.0:1788940399.571909:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718272512 00000100:00100000:3.0:1788940399.572006:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 226 00000100:00100000:3.0:1788940399.572017:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18415d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:2353:x1875839718272512:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788940399.572110:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18415d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:2353:x1875839718272512:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 94us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940399.572118:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 226 00000100:00100000:1.0:1788940399.575067:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718272640 00000100:00100000:1.0:1788940399.575089:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718272640 00000100:00100000:1.0:1788940399.575192:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 72 00000100:00100000:1.0:1788940399.575205:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b55ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2353:x1875839718272640:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788940399.575360:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b55ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2353:x1875839718272640:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 157us (3646us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940399.575368:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 72 00000100:00100000:2.0:1788940399.577696:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffa310cd-169f-42e3-8999-506116bada08+6:2349:x1875839718272128:12345-192.168.202.14@tcp:38:mount.lustre.0 Request processed in 10562us (10981us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940399.577715:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 10 00000100:00100000:3.0:1788940399.591212:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940399.591309:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940399.599699:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718272256 00000100:00100000:2.0:1788940399.599722:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718272256 00000100:00100000:2.0:1788940399.600052:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718272384 00000100:00100000:2.0:1788940399.600057:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718272384 00000100:00100000:2.0:1788940399.600093:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 11 00000100:00100000:2.0:1788940399.600104:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f184195880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffa310cd-169f-42e3-8999-506116bada08+7:0:x1875839718272256:12345-192.168.202.14@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788940399.600166:0:5860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788940399.600303:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f184195880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffa310cd-169f-42e3-8999-506116bada08+7:0:x1875839718272256:12345-192.168.202.14@tcp:41:mount.lustre.0 Request processed in 201us (9108us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940399.600311:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 11 00000100:00100000:2.0:1788940399.600332:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 12 00000100:00100000:2.0:1788940399.600339:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f184194000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffa310cd-169f-42e3-8999-506116bada08+6:8137:x1875839718272384:12345-192.168.202.14@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788940399.600350:0:5860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788940399.600371:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f184194000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffa310cd-169f-42e3-8999-506116bada08+6:8137:x1875839718272384:12345-192.168.202.14@tcp:41:mount.lustre.0 Request processed in 33us (9063us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940399.600378:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 12 00000100:00080000:0.0:1788940399.604785:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788940399.606042:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940399.609172:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718272768 00000100:00100000:2.0:1788940399.609195:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718272768 00000100:00100000:0.0:1788940399.612359:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 13 00000100:00100000:0.0:1788940399.612378:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b55ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffa310cd-169f-42e3-8999-506116bada08+6:8137:x1875839718272768:12345-192.168.202.14@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788940399.612782:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b55ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffa310cd-169f-42e3-8999-506116bada08+6:8137:x1875839718272768:12345-192.168.202.14@tcp:40:mount.lustre.0 Request processed in 407us (6751us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940399.612791:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 13 00000100:00100000:2.0:1788940399.623270:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940399.623338:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940399.623362:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940399.623608:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718272896 00000100:00100000:3.0:1788940399.623621:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718272896 00000100:00100000:3.0:1788940399.623665:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718273024 00000100:00100000:3.0:1788940399.623668:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718273024 00000100:00100000:3.0:1788940399.623688:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 12 00000100:00100000:3.0:1788940399.623697:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae81df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2349:x1875839718272896:12345-192.168.202.14@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788940399.623747:0:6707:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from ffa310cd-169f-42e3-8999-506116bada08@192.168.202.14@tcp t0 exp 0000000000000000 cur 342 last 0 00000020:00000080:3.0:1788940399.623786:0:6707:0:(genops.c:1393:class_connect()) connect: client ffa310cd-169f-42e3-8999-506116bada08, cookie 0x27a633fcdd4ab81 00002000:00100000:3.0:1788940399.623802:0:6707:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ffa310cd-169f-42e3-8999-506116bada08/ffff89f192363800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788940399.623833:0:6707:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788940399.624293:0:6707:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788940399.624334:0:6707:0:(import.c:65:import_set_state_nolock()) ffff89f192360800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788940399.624676:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae81df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffa310cd-169f-42e3-8999-506116bada08+6:2349:x1875839718272896:12345-192.168.202.14@tcp:8:mount.lustre.0 Request processed in 976us (1334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940399.624686:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 12 00000100:00100000:3.0:1788940399.624718:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 13 00000100:00100000:3.0:1788940399.624725:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae81d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2349:x1875839718273024:12345-192.168.202.14@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788940399.624749:0:6707:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from ffa310cd-169f-42e3-8999-506116bada08@192.168.202.14@tcp t0 exp 0000000000000000 cur 342 last 0 00000020:00000080:3.0:1788940399.624789:0:6707:0:(genops.c:1393:class_connect()) connect: client ffa310cd-169f-42e3-8999-506116bada08, cookie 0x27a633fcdd4ab88 00002000:00100000:3.0:1788940399.624800:0:6707:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ffa310cd-169f-42e3-8999-506116bada08/ffff89f192363000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788940399.624822:0:6707:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:1.0:1788940399.625022:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718273152 00000100:00100000:1.0:1788940399.625031:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718273152 00000100:00100000:1.0:1788940399.625088:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 1 00000100:00100000:1.0:1788940399.625097:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae81f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffa310cd-169f-42e3-8999-506116bada08+6:8137:x1875839718273152:12345-192.168.202.14@tcp:33:mount.lustre.0 00000004:00200000:1.0:1788940399.625180:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788940399.625253:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae81f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffa310cd-169f-42e3-8999-506116bada08+6:8137:x1875839718273152:12345-192.168.202.14@tcp:33:mount.lustre.0 Request processed in 157us (1999us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940399.625260:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 1 00002000:00080000:3.0:1788940399.625722:0:6707:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788940399.625765:0:6707:0:(import.c:65:import_set_state_nolock()) ffff89f192364800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788940399.625802:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae81d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffa310cd-169f-42e3-8999-506116bada08+6:2349:x1875839718273024:12345-192.168.202.14@tcp:8:mount.lustre.0 Request processed in 1075us (2437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940399.625811:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 13 00000100:00100000:2.0:1788940400.109642:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f184195c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738230272:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788940400.109751:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940400.109903:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738230272 00000100:00100000:1.0:1788940400.109913:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738230272 00000100:00100000:1.0:1788940400.109995:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788940400.110006:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae81c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738230272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788940400.110033:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788940400.110124:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788940400.119159:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae81c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738230272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 9139us (9390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940400.119180:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1788940400.119406:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f184195c00 x1875839738230272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940416 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940400.119441:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f184195c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738230272:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788940400.304635:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788940400.723918:0:6732:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ffa310cd-169f-42e3-8999-506116bada08 00000100:00100000:3.0:1788940401.133299:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f184197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875839738230528:0@lo:400:kworker.0 00000100:00100000:2.0:1788940401.133489:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f184194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3308:1875839738230400:0@lo:400:kworker.0 00000100:00100000:1.0:1788940401.133620:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f184197b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738230784:0@lo:400:kworker.0 00000100:00100000:2.0:1788940401.138246:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940401.138363:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f184196d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875839738230912:0@lo:400:kworker.0 00000100:00100000:2.0:1788940401.138557:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940401.138642:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f184197800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875839738230656:0@lo:400:kworker.0 00000100:00100000:2.0:1788940401.138683:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940401.138745:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738230400 00000100:00100000:2.0:1788940401.138755:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738230400 00000100:00100000:2.0:1788940401.139062:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1788940401.139077:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3308:x1875839738230400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940401.139148:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3308:x1875839738230400:12345-0@lo:400:kworker.0 Request processed in 74us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940401.139155:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1788940401.139196:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738230912 00000100:00100000:2.0:1788940401.139200:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738230912 00000100:00100000:2.0:1788940401.139258:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738230656 00000100:00100000:2.0:1788940401.139263:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738230656 00000100:00100000:2.0:1788940401.139310:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788940401.139323:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae81dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875839738230912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940401.139364:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae81dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875839738230912:12345-0@lo:400:kworker.0 Request processed in 47us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940401.139464:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788940401.139480:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788940401.139486:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae81ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875839738230656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940401.139558:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae81ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875839738230656:12345-0@lo:400:kworker.0 Request processed in 72us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940401.139565:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:2.0:1788940401.139593:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940401.139712:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f184197800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875839738230656:0@lo:400:kworker.0 00000100:00100000:2.0:1788940401.139763:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f184194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3308:1875839738230400:0@lo:400:kworker.0 00000100:00100000:2.0:1788940401.139775:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f184196d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875839738230912:0@lo:400:kworker.0 00000100:00100000:1.0:1788940401.140007:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940401.141627:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738230784 00000100:00100000:0.0:1788940401.141641:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738230784 00000100:00100000:0.0:1788940401.141918:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788940401.141930:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf555500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738230784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940401.142085:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf555500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738230784:12345-0@lo:400:kworker.0 Request processed in 157us (2077us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940401.142093:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1788940401.143636:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f184197b80 x1875839738230784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940401.143656:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f184197b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738230784:0@lo:400:kworker.0 00000100:00100000:3.0:1788940401.147678:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940401.147774:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738230528 00000100:00100000:0.0:1788940401.147791:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738230528 00000100:00100000:0.0:1788940401.147860:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788940401.147872:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f184196300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875839738230528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940401.147962:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f184196300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875839738230528:12345-0@lo:400:kworker.0 Request processed in 92us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940401.147970:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788940401.150445:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f184197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875839738230528:0@lo:400:kworker.0 00000100:00100000:3.0:1788940401.150468:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f184196a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738231040:0@lo:400:kworker.0 00000100:00100000:3.0:1788940401.150581:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940401.150663:0:7074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738231040 00000100:00100000:0.0:1788940401.150679:0:7074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738231040 00000100:00100000:0.0:1788940401.150768:0:7074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788940401.150781:0:7074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f184194e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738231040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940401.150871:0:7074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f184194e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738231040:12345-0@lo:400:kworker.0 Request processed in 94us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940401.150878:0:7074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1788940401.150979:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f184196a00 x1875839738231040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940401.150993:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f184196a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738231040:0@lo:400:kworker.0 00000100:00080000:2.0:1788940401.151701:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788940401.331306:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940401.645075:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bfae9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738231168:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788940401.645158:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940401.646154:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738231168 00000100:00100000:1.0:1788940401.646169:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738231168 00000100:00100000:1.0:1788940401.646487:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788940401.646501:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfae8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738231168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788940401.646562:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788940401.646631:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfae8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738231168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (1473us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940401.646638:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1788940401.647143:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1bfae9500 x1875839738231168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940417 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940401.647165:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bfae9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738231168:0@lo:13:osp-pre-1-0.0 00000001:00100000:0.0:1788940402.214118:0:5883:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ffa310cd-169f-42e3-8999-506116bada08 00000001:00100000:0.0:1788940402.218931:0:7662:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ffa310cd-169f-42e3-8999-506116bada08 00010000:00010000:1.0:1788940402.352121:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940403.372816:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940404.396970:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940404.727619:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940404.727663:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940404.727692:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940404.727831:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718273536 00000100:00100000:2.0:1788940404.727843:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718273536 00000100:00100000:2.0:1788940404.727928:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 76 00000100:00100000:2.0:1788940404.727938:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f184196a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffa310cd-169f-42e3-8999-506116bada08+5:2351:x1875839718273536:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788940404.728030:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f184196a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffa310cd-169f-42e3-8999-506116bada08+5:2351:x1875839718273536:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 92us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940404.728037:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 76 00000100:00100000:0.0:1788940404.728251:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718273280 00000100:00100000:0.0:1788940404.728257:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718273280 00000100:00100000:0.0:1788940404.728300:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 228 00000100:00100000:0.0:1788940404.728308:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:2351:x1875839718273280:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788940404.728350:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:2351:x1875839718273280:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 42us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940404.728357:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 228 00000100:00100000:3.0:1788940404.728736:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940404.728769:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940404.728789:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718273408 00000100:00100000:3.0:1788940404.728808:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718273408 00000100:00100000:3.0:1788940404.728843:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 77 00000100:00100000:3.0:1788940404.728851:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f184196680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2351:x1875839718273408:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788940404.728890:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f184196680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2351:x1875839718273408:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 40us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940404.728897:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 77 00000100:00100000:2.0:1788940404.728914:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718273792 00000100:00100000:2.0:1788940404.728920:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718273792 00000100:00100000:2.0:1788940404.728956:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718273664 00000100:00100000:2.0:1788940404.728959:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718273664 00000100:00100000:2.0:1788940404.728983:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 41 00000100:00100000:2.0:1788940404.728991:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f184197100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffa310cd-169f-42e3-8999-506116bada08+5:2351:x1875839718273792:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788940404.729034:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f184197100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffa310cd-169f-42e3-8999-506116bada08+5:2351:x1875839718273792:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 43us (1340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940404.729041:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 41 00000100:00100000:2.0:1788940404.729053:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 42 00000100:00100000:2.0:1788940404.729059:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f192603850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffa310cd-169f-42e3-8999-506116bada08+5:2351:x1875839718273664:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788940404.729102:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f192603850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffa310cd-169f-42e3-8999-506116bada08+5:2351:x1875839718273664:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 42us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940404.729109:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 42 00000100:00080000:1.0:1788940404.729123:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788940404.729129:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788940404.729133:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940405.229009:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f184194380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738231296:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788940405.229098:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940405.229328:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738231296 00000100:00100000:3.0:1788940405.229339:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738231296 00000100:00100000:3.0:1788940405.229419:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788940405.229430:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfae9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738231296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788940405.229495:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788940405.229579:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfae9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738231296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 150us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940405.229587:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1788940405.229654:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f184194380 x1875839738231296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940421 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940405.229678:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f184194380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738231296:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788940405.230090:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788940405.422418:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940406.252650:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f184194380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3308:1875839738231424:0@lo:400:kworker.0 00000100:00100000:1.0:1788940406.252733:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940406.252783:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f184197480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738231808:0@lo:400:kworker.0 00000100:00100000:1.0:1788940406.252798:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f184194e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875839738231936:0@lo:400:kworker.0 00000100:00100000:3.0:1788940406.252816:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940406.252841:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940406.252858:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f184195180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875839738231552:0@lo:400:kworker.0 00000100:00100000:1.0:1788940406.252881:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f184195500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875839738231680:0@lo:400:kworker.0 00000100:00100000:3.0:1788940406.252887:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940406.252911:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f184197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738232064:0@lo:400:kworker.0 00000100:00100000:1.0:1788940406.252924:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940406.252935:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940406.252970:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738231936 00000100:00100000:3.0:1788940406.252977:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738231936 00000100:00100000:1.0:1788940406.253084:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738231424 00000100:00100000:1.0:1788940406.253090:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738231424 00000100:00100000:3.0:1788940406.253110:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738231552 00000100:00100000:3.0:1788940406.253117:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738231552 00000100:00100000:1.0:1788940406.253128:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788940406.253139:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738231680 00000100:00100000:1.0:1788940406.253141:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3308:x1875839738231424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940406.253143:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738231680 00000100:00100000:3.0:1788940406.253165:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788940406.253171:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfae9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875839738231936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940406.253202:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3308:x1875839738231424:12345-0@lo:400:kworker.0 Request processed in 63us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940406.253209:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfae9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875839738231936:12345-0@lo:400:kworker.0 Request processed in 38us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940406.253213:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788940406.253237:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788940406.253258:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788940406.253264:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738231808 00000100:00100000:3.0:1788940406.253265:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f184196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875839738231552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940406.253269:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738231808 00000100:00100000:1.0:1788940406.253302:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738232064 00000100:00100000:1.0:1788940406.253306:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738232064 00000100:00100000:3.0:1788940406.253311:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f184196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875839738231552:12345-0@lo:400:kworker.0 Request processed in 46us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940406.253317:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788940406.253334:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788940406.253338:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788940406.253343:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfae9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875839738231680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940406.253350:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f184197b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738231808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940406.253373:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfae9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875839738231680:12345-0@lo:400:kworker.0 Request processed in 32us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940406.253378:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788940406.253407:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f184195180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875839738231552:0@lo:400:kworker.0 00000100:00100000:1.0:1788940406.253483:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f184197b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738231808:12345-0@lo:400:kworker.0 Request processed in 137us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940406.253491:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788940406.253503:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788940406.253509:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f184194a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738232064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940406.253563:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f184194a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738232064:12345-0@lo:400:kworker.0 Request processed in 53us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940406.253569:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1788940406.253598:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788940406.253602:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940406.253633:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f184195500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875839738231680:0@lo:400:kworker.0 00010000:00080000:1.0:1788940406.253661:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f184197100 x1875839738232064/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940406.253684:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f184197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738232064:0@lo:400:kworker.0 00000100:00100000:1.0:1788940406.253712:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f184194e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875839738231936:0@lo:400:kworker.0 00000100:00100000:1.0:1788940406.253720:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f184194380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3308:1875839738231424:0@lo:400:kworker.0 00010000:00080000:3.0:1788940406.254328:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f184197480 x1875839738231808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940406.254336:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f184197480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738231808:0@lo:400:kworker.0 00010000:00010000:2.0:1788940406.444879:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788940406.457323:0:10343:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg214-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:3.0:1788940406.764788:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788940406.764809:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bfaead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738232192:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788940406.764884:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940406.765176:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738232192 00000100:00100000:1.0:1788940406.765186:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738232192 00000100:00100000:1.0:1788940406.765279:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788940406.765288:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f184197480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738232192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788940406.765321:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788940406.765367:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f184197480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738232192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940406.765372:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1788940406.765483:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1bfaead80 x1875839738232192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940422 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940406.765508:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bfaead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738232192:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788940407.472979:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940408.492807:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940409.519110:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940409.849485:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940409.849581:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940409.849620:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940409.849640:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940409.849795:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940409.853756:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718274304 00000100:00100000:2.0:1788940409.853779:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718274304 00000100:00100000:2.0:1788940409.853855:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718274432 00000100:00100000:2.0:1788940409.853858:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718274432 00000100:00100000:2.0:1788940409.853881:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 45 00000100:00100000:2.0:1788940409.853892:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b55aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ffa310cd-169f-42e3-8999-506116bada08+5:2351:x1875839718274304:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788940409.853969:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b55aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ffa310cd-169f-42e3-8999-506116bada08+5:2351:x1875839718274304:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 79us (4388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940409.853976:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 45 00000100:00100000:2.0:1788940409.853992:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 46 00000100:00100000:2.0:1788940409.853998:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b55a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ffa310cd-169f-42e3-8999-506116bada08+5:2350:x1875839718274432:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788940409.854015:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b55a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ffa310cd-169f-42e3-8999-506116bada08+5:2350:x1875839718274432:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 18us (4221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940409.854021:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 46 00000100:00100000:2.0:1788940409.854039:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718273920 00000100:00100000:2.0:1788940409.854053:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718273920 00000100:00100000:2.0:1788940409.854075:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 230 00000100:00100000:2.0:1788940409.854080:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:2350:x1875839718273920:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788940409.854101:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:2350:x1875839718273920:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 21us (4481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940409.854106:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 230 00000100:00080000:2.0:1788940409.854134:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788940409.854138:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788940409.860031:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718274048 00000100:00100000:3.0:1788940409.860051:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718274048 00000100:00100000:2.0:1788940409.860261:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718274176 00000100:00100000:2.0:1788940409.860266:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718274176 00000100:00100000:2.0:1788940409.860298:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 81 00000100:00100000:2.0:1788940409.860309:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b55abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2351:x1875839718274048:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788940409.860402:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b55abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2351:x1875839718274048:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 94us (10927us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940409.860410:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 81 00000100:00100000:2.0:1788940409.860429:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 82 00000100:00100000:2.0:1788940409.860436:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b55a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffa310cd-169f-42e3-8999-506116bada08+5:2350:x1875839718274176:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788940409.860462:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b55a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffa310cd-169f-42e3-8999-506116bada08+5:2350:x1875839718274176:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 27us (10821us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940409.860468:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 82 00000100:00080000:3.0:1788940409.861080:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940410.348736:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f184195180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738232320:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788940410.348816:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940410.349016:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738232320 00000100:00100000:3.0:1788940410.349027:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738232320 00000100:00100000:3.0:1788940410.349111:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788940410.349123:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfae8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738232320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788940410.349166:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788940410.349233:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfae8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738232320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940410.349240:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1788940410.349306:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788940410.349383:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f184195180 x1875839738232320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940426 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940410.349405:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f184195180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738232320:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788940410.540918:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940411.375275:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bfaeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3308:1875839738232448:0@lo:400:kworker.0 00000100:00100000:2.0:1788940411.375362:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940411.375417:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b500f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875839738232960:0@lo:400:kworker.0 00000100:00100000:2.0:1788940411.375460:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940411.375488:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788940411.375494:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bfaead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738232832:0@lo:400:kworker.0 00000100:00100000:2.0:1788940411.375551:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940411.375579:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bfae8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875839738232704:0@lo:400:kworker.0 00000100:00100000:2.0:1788940411.375601:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940411.375619:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788940411.375624:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bfae8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875839738232576:0@lo:400:kworker.0 00000100:00100000:2.0:1788940411.380311:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940411.380367:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b500ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738233088:0@lo:400:kworker.0 00000100:00100000:2.0:1788940411.380392:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940411.380449:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738232448 00000100:00100000:2.0:1788940411.380460:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738232448 00000100:00100000:2.0:1788940411.380529:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1788940411.380540:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3308:x1875839738232448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940411.380599:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3308:x1875839738232448:12345-0@lo:400:kworker.0 Request processed in 60us (5237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940411.380606:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1788940411.380640:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738232960 00000100:00100000:2.0:1788940411.380645:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738232960 00000100:00100000:2.0:1788940411.380678:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738232704 00000100:00100000:2.0:1788940411.380682:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738232704 00000100:00100000:2.0:1788940411.380693:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738232576 00000100:00100000:2.0:1788940411.380696:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738232576 00000100:00100000:2.0:1788940411.380707:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788940411.380713:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae81df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875839738232960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940411.380747:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae81df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875839738232960:12345-0@lo:400:kworker.0 Request processed in 35us (5286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940411.380763:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788940411.380775:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788940411.380781:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae81f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875839738232704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940411.380812:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae81f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875839738232704:12345-0@lo:400:kworker.0 Request processed in 31us (5210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940411.380817:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788940411.380826:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788940411.380831:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae81f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875839738232576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940411.380852:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae81f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875839738232576:12345-0@lo:400:kworker.0 Request processed in 21us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940411.380857:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788940411.380872:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738232832 00000100:00100000:2.0:1788940411.380875:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738232832 00000100:00100000:2.0:1788940411.380892:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738233088 00000100:00100000:2.0:1788940411.380894:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738233088 00000100:00100000:2.0:1788940411.380910:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788940411.380916:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae81d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738232832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940411.380942:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae81d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738232832:12345-0@lo:400:kworker.0 Request processed in 27us (5392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940411.380948:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788940411.380956:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788940411.380961:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae81fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738233088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940411.380981:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae81fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738233088:12345-0@lo:400:kworker.0 Request processed in 21us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940411.380987:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:2.0:1788940411.381039:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1bfaead80 x1875839738232832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940427 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940411.381055:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bfaead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738232832:0@lo:400:kworker.0 00000100:00100000:2.0:1788940411.381064:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bfaeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3308:1875839738232448:0@lo:400:kworker.0 00000100:00100000:2.0:1788940411.381074:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b500f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875839738232960:0@lo:400:kworker.0 00000100:00080000:2.0:1788940411.381100:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788940411.381105:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940411.381120:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bfae8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875839738232576:0@lo:400:kworker.0 00010000:00080000:2.0:1788940411.381128:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1b500ed80 x1875839738233088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940427 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940411.381137:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b500ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738233088:0@lo:400:kworker.0 00000100:00100000:2.0:1788940411.381146:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bfae8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875839738232704:0@lo:400:kworker.0 00010000:00010000:2.0:1788940411.566728:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940411.885272:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b500f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738233216:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788940411.885348:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940411.885461:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738233216 00000100:00100000:0.0:1788940411.885471:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738233216 00000100:00100000:0.0:1788940411.885561:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788940411.885573:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae81ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738233216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788940411.885630:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788940411.889374:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae81ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738233216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3793us (4016us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940411.889390:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1788940411.894373:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1b500f480 x1875839738233216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940427 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940411.894403:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b500f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738233216:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788940412.592799:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940413.612939:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940414.637759:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940414.972393:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940414.972436:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940414.972470:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940414.972504:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940414.972563:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940414.972594:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718275072 00000100:00100000:3.0:1788940414.972742:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718274816 00000100:00100000:3.0:1788940414.972754:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718274816 00000100:00100000:3.0:1788940414.972823:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718274688 00000100:00100000:3.0:1788940414.972826:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718274688 00000100:00100000:3.0:1788940414.972849:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 86 00000100:00100000:3.0:1788940414.972861:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b55a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffa310cd-169f-42e3-8999-506116bada08+5:2353:x1875839718274816:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788940414.972945:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b55a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffa310cd-169f-42e3-8999-506116bada08+5:2353:x1875839718274816:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 86us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940414.972953:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 86 00000100:00100000:3.0:1788940414.972987:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 87 00000100:00100000:3.0:1788940414.972995:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b55a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2353:x1875839718274688:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788940414.973023:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b55a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2353:x1875839718274688:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 30us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940414.973030:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 87 00000100:00080000:3.0:1788940414.973051:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940414.973644:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718274560 00000100:00100000:1.0:1788940414.973651:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718274560 00000100:00100000:1.0:1788940414.973706:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 232 00000100:00100000:1.0:1788940414.973715:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:2353:x1875839718274560:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788940414.973760:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:2353:x1875839718274560:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 47us (1375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940414.973776:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 232 00000100:00100000:0.0:1788940414.974211:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718275072 00000100:00100000:0.0:1788940414.974265:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718274944 00000100:00100000:0.0:1788940414.974268:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718274944 00000100:00100000:0.0:1788940414.974292:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 49 00000100:00100000:0.0:1788940414.974299:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b55a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ffa310cd-169f-42e3-8999-506116bada08+5:2353:x1875839718275072:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788940414.974337:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b55a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ffa310cd-169f-42e3-8999-506116bada08+5:2353:x1875839718275072:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 39us (1866us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940414.974357:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 49 00000100:00100000:0.0:1788940414.974379:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 50 00000100:00100000:0.0:1788940414.974385:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b55aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ffa310cd-169f-42e3-8999-506116bada08+5:2353:x1875839718274944:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788940414.974410:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b55aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ffa310cd-169f-42e3-8999-506116bada08+5:2353:x1875839718274944:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 26us (1847us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940414.974416:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 50 00000100:00080000:3.0:1788940414.974898:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788940414.974904:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788940415.469022:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788940415.469048:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f184197800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738233344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788940415.469124:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940415.469445:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738233344 00000100:00100000:1.0:1788940415.469458:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738233344 00000100:00100000:1.0:1788940415.469763:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788940415.469777:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f184195c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738233344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788940415.470016:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788940415.470087:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f184195c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738233344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 313us (963us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940415.470094:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:3.0:1788940415.470299:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788940415.470366:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f184197800 x1875839738233344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940431 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940415.470389:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f184197800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738233344:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788940415.672241:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940416.493735:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788940416.493768:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b500fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875839738233728:0@lo:400:kworker.0 00000100:00100000:1.0:1788940416.493771:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b500f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738233856:0@lo:400:kworker.0 00000100:00100000:2.0:1788940416.493874:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b500d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3308:1875839738233472:0@lo:400:kworker.0 00000100:00100000:0.0:1788940416.499634:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b500f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738234112:0@lo:400:kworker.0 00000100:00100000:3.0:1788940416.500237:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940416.500317:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b500e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875839738233600:0@lo:400:kworker.0 00000100:00100000:3.0:1788940416.500348:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940416.500403:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738233728 00000100:00100000:3.0:1788940416.500412:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738233728 00000100:00100000:3.0:1788940416.500489:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738233600 00000100:00100000:3.0:1788940416.500493:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738233600 00000100:00100000:3.0:1788940416.500541:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788940416.500551:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f184195f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875839738233728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940416.500633:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f184195f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875839738233728:12345-0@lo:400:kworker.0 Request processed in 83us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940416.500641:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788940416.500664:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788940416.500688:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f184194700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875839738233600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940416.500852:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f184194700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875839738233600:12345-0@lo:400:kworker.0 Request processed in 165us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940416.500859:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:3.0:1788940416.500886:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788940416.500923:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b500fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875839738233728:0@lo:400:kworker.0 00000100:00100000:3.0:1788940416.500948:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b500e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875839738233600:0@lo:400:kworker.0 00000100:00100000:2.0:1788940416.502344:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940416.502387:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738233472 00000100:00100000:2.0:1788940416.502396:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738233472 00000100:00100000:2.0:1788940416.502447:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1788940416.502457:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3308:x1875839738233472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940416.502507:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3308:x1875839738233472:12345-0@lo:400:kworker.0 Request processed in 51us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940416.502597:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940416.502637:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738233856 00000100:00100000:1.0:1788940416.502641:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738233856 00000100:00100000:1.0:1788940416.502678:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788940416.502684:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b500e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738233856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940416.502724:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b500e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738233856:12345-0@lo:400:kworker.0 Request processed in 40us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940416.502732:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:1.0:1788940416.502799:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1b500f480 x1875839738233856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940416.502814:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b500f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738233856:0@lo:400:kworker.0 00000100:00100000:2.0:1788940416.504978:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1788940416.505065:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b500d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3308:1875839738233472:0@lo:400:kworker.0 00000100:00100000:3.0:1788940416.505219:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b500ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875839738233984:0@lo:400:kworker.0 00000100:00100000:3.0:1788940416.505294:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940416.505333:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738233984 00000100:00100000:3.0:1788940416.505340:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738233984 00000100:00100000:3.0:1788940416.505398:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788940416.505405:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f184197800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875839738233984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940416.506789:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f184197800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875839738233984:12345-0@lo:400:kworker.0 Request processed in 1376us (1487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940416.506806:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:3.0:1788940416.506857:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788940416.507990:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b500ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875839738233984:0@lo:400:kworker.0 00000100:00100000:0.0:1788940416.509603:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940416.509669:0:7074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738234112 00000100:00100000:0.0:1788940416.509681:0:7074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738234112 00000100:00100000:0.0:1788940416.509760:0:7074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788940416.509773:0:7074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf97c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738234112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940416.509845:0:7074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf97c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738234112:12345-0@lo:400:kworker.0 Request processed in 75us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940416.509867:0:7074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:0.0:1788940416.509899:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788940416.509939:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1b500f100 x1875839738234112/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940416.509955:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b500f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738234112:0@lo:400:kworker.0 00010000:00010000:2.0:1788940416.690309:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940417.005766:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788940417.005799:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b500f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738234240:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788940417.005900:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940417.005993:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738234240 00000100:00100000:1.0:1788940417.006014:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738234240 00000100:00100000:1.0:1788940417.006069:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788940417.006080:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b500fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738234240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788940417.006136:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788940417.006190:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b500fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738234240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940417.006197:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1788940417.006250:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1b500f480 x1875839738234240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940433 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940417.006273:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b500f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738234240:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788940417.709161:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940418.738131:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940419.768211:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940420.094334:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940420.094366:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940420.094399:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940420.094424:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940420.094448:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940420.094493:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718275200 00000100:00100000:3.0:1788940420.094506:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718275200 00000100:00100000:1.0:1788940420.094557:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718275584 00000100:00100000:1.0:1788940420.094562:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718275584 00000100:00100000:3.0:1788940420.094587:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 234 00000100:00100000:1.0:1788940420.094595:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718275712 00000100:00100000:3.0:1788940420.094597:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:2351:x1875839718275200:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788940420.094598:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718275712 00000100:00100000:1.0:1788940420.094618:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 14 00000100:00100000:1.0:1788940420.094623:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f184195180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ffa310cd-169f-42e3-8999-506116bada08+5:2349:x1875839718275584:12345-192.168.202.14@tcp:9:kworker.0 00000020:00000080:1.0:1788940420.094644:0:6708:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x27a633fcdd4ab81 00000100:00080000:1.0:1788940420.094653:0:6708:0:(import.c:65:import_set_state_nolock()) ffff89f192360800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788940420.094673:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:2351:x1875839718275200:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 77us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940420.094680:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 234 00000001:00000004:1.0:1788940420.094691:0:6708:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788940420.094713:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718275456 00000100:00100000:3.0:1788940420.094716:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718275456 00000100:00100000:3.0:1788940420.094739:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718275328 00000100:00100000:3.0:1788940420.094742:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718275328 00000100:00100000:3.0:1788940420.094757:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 91 00000100:00100000:3.0:1788940420.094762:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f184194e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffa310cd-169f-42e3-8999-506116bada08+5:2351:x1875839718275456:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788940420.094789:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f184194e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffa310cd-169f-42e3-8999-506116bada08+5:2351:x1875839718275456:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 27us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940420.094795:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 91 00000100:00100000:3.0:1788940420.094806:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 92 00000100:00100000:3.0:1788940420.094811:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f184197100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2351:x1875839718275328:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788940420.094831:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f184197100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2351:x1875839718275328:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 20us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940420.094836:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 92 00000100:00100000:1.0:1788940420.095021:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f184195180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ffa310cd-169f-42e3-8999-506116bada08+2:2349:x1875839718275584:12345-192.168.202.14@tcp:9:kworker.0 Request processed in 395us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940420.095028:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 14 00000100:00100000:2.0:1788940420.095040:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 15 00000100:00100000:2.0:1788940420.095131:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f184194380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffa310cd-169f-42e3-8999-506116bada08+5:2349:x1875839718275712:12345-192.168.202.14@tcp:9:kworker.0 00000020:00000080:2.0:1788940420.095147:0:6707:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x27a633fcdd4ab88 00000100:00080000:2.0:1788940420.095153:0:6707:0:(import.c:65:import_set_state_nolock()) ffff89f192364800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788940420.095186:0:6707:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788940420.095398:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f184194380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffa310cd-169f-42e3-8999-506116bada08+2:2349:x1875839718275712:12345-192.168.202.14@tcp:9:kworker.0 Request processed in 350us (1030us total) trans 0 rc 0/0 00010000:00010000:3.0:1788940420.095495:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940420.099067:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 15 00000100:00080000:1.0:1788940420.107103:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788940420.107132:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788940420.107138:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788940420.107141:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788940420.588833:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788940420.588868:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f184195500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738234368:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788940420.588944:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940420.589309:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738234368 00000100:00100000:2.0:1788940420.589320:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738234368 00000100:00100000:2.0:1788940420.589392:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788940420.589412:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf97dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738234368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788940420.589454:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788940420.589505:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf97dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738234368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940420.589513:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1788940420.589599:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788940420.589643:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f184195500 x1875839738234368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940436 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940420.589663:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f184195500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738234368:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788940420.781780:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788940421.197655:0:6732:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ffa310cd-169f-42e3-8999-506116bada08 00000020:00000080:2.0:1788940421.197666:0:6732:0:(genops.c:893:class_export_put()) final put ffff89f192363800/ffa310cd-169f-42e3-8999-506116bada08 00000020:00000080:2.0:1788940421.197695:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffff89f192363800/ffa310cd-169f-42e3-8999-506116bada08 for lustre-OST0000 00000020:00000080:2.0:1788940421.197739:0:36:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff89f192360800 for lustre-OST0000 00000100:00100000:3.0:1788940421.612906:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b8bf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738234880:0@lo:400:kworker.0 00000100:00100000:3.0:1788940421.612988:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940421.613039:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788940421.613049:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f184195500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3307:1875839738234496:0@lo:400:kworker.0 00000100:00100000:3.0:1788940421.613097:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940421.613126:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b8bf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875839738235008:0@lo:400:kworker.0 00000100:00100000:3.0:1788940421.613149:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940421.613179:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b8bf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875839738234624:0@lo:400:kworker.0 00000100:00100000:3.0:1788940421.613202:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940421.613219:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b8bf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738235136:0@lo:400:kworker.0 00000100:00100000:3.0:1788940421.613242:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940421.613259:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788940421.613264:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b8bf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875839738234752:0@lo:400:kworker.0 00000100:00100000:3.0:1788940421.613283:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940421.613321:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738234880 00000100:00100000:3.0:1788940421.613329:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738234880 00000100:00100000:3.0:1788940421.613461:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738235136 00000100:00100000:3.0:1788940421.613465:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738235136 00000100:00100000:3.0:1788940421.613497:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788940421.613507:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b8bf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738234880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940421.613677:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b8bf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738234880:12345-0@lo:400:kworker.0 Request processed in 171us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940421.613687:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788940421.613705:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788940421.613711:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b8bf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738235136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940421.613738:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b8bf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738235136:12345-0@lo:400:kworker.0 Request processed in 28us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940421.613744:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788940421.613759:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738235008 00000100:00100000:3.0:1788940421.613762:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738235008 00000100:00100000:3.0:1788940421.613792:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738234624 00000100:00100000:3.0:1788940421.613936:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738234624 00000100:00100000:3.0:1788940421.613953:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738234752 00000100:00100000:3.0:1788940421.613955:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738234752 00000100:00100000:3.0:1788940421.613968:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788940421.613973:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b8bf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875839738235008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940421.614002:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b8bf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875839738235008:12345-0@lo:400:kworker.0 Request processed in 30us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940421.614008:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788940421.614019:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788940421.614024:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b8bf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875839738234624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940421.614044:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b8bf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875839738234624:12345-0@lo:400:kworker.0 Request processed in 21us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940421.614049:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788940421.614056:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788940421.614061:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b8bf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875839738234752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940421.614091:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b8bf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875839738234752:12345-0@lo:400:kworker.0 Request processed in 29us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940421.614097:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788940421.614161:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b8bf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875839738234752:0@lo:400:kworker.0 00000100:00100000:3.0:1788940421.614173:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b8bf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875839738234624:0@lo:400:kworker.0 00010000:00080000:3.0:1788940421.614186:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1b8bf6a00 x1875839738235136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940437 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940421.614196:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b8bf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738235136:0@lo:400:kworker.0 00000100:00100000:3.0:1788940421.614234:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b8bf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875839738235008:0@lo:400:kworker.0 00010000:00080000:3.0:1788940421.614255:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1b8bf7b80 x1875839738234880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940437 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940421.614264:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b8bf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738234880:0@lo:400:kworker.0 00000100:00100000:2.0:1788940421.614358:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738234496 00000100:00100000:2.0:1788940421.614364:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738234496 00000100:00100000:2.0:1788940421.614400:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1788940421.614417:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3307:x1875839738234496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940421.614461:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3307:x1875839738234496:12345-0@lo:400:kworker.0 Request processed in 47us (1363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940421.614467:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1788940421.614507:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f184195500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3307:1875839738234496:0@lo:400:kworker.0 00000100:00080000:0.0:1788940421.614673:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788940421.614679:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788940421.808754:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940422.128597:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788940422.128619:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b8bf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738235264:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788940422.128693:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940422.128764:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738235264 00000100:00100000:3.0:1788940422.128774:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738235264 00000100:00100000:3.0:1788940422.128827:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788940422.128911:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b8bf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738235264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788940422.128952:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788940422.129000:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b8bf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738235264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940422.129007:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1788940422.129062:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1b8bf7b80 x1875839738235264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940438 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940422.129096:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b8bf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738235264:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1788940422.688128:0:7662:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ffa310cd-169f-42e3-8999-506116bada08 00000020:00000080:2.0:1788940422.688140:0:7662:0:(genops.c:893:class_export_put()) final put ffff89f192363000/ffa310cd-169f-42e3-8999-506116bada08 00000020:00000080:2.0:1788940422.688169:0:38:0:(genops.c:852:class_export_destroy()) destroying export ffff89f192363000/ffa310cd-169f-42e3-8999-506116bada08 for lustre-OST0001 00000020:00000080:2.0:1788940422.688221:0:38:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff89f192364800 for lustre-OST0001 00010000:00010000:3.0:1788940422.828935:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940423.853292:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940424.879855:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940425.216402:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940425.216438:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940425.216463:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940425.216493:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718275968 00000100:00100000:3.0:1788940425.216506:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718275968 00000100:00100000:3.0:1788940425.216601:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718276096 00000100:00100000:3.0:1788940425.216613:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718276096 00000100:00100000:3.0:1788940425.216642:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 96 00000100:00100000:3.0:1788940425.216653:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b8bf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2351:x1875839718275968:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788940425.216736:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b8bf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2351:x1875839718275968:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 85us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940425.216743:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 96 00000100:00100000:3.0:1788940425.216762:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 97 00000100:00100000:3.0:1788940425.216768:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b8bf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffa310cd-169f-42e3-8999-506116bada08+5:2351:x1875839718276096:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788940425.216790:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b8bf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffa310cd-169f-42e3-8999-506116bada08+5:2351:x1875839718276096:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 23us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940425.216797:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 97 00000100:00100000:3.0:1788940425.216813:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718275840 00000100:00100000:3.0:1788940425.216816:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718275840 00000100:00100000:3.0:1788940425.216838:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 236 00000100:00100000:3.0:1788940425.216843:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:2351:x1875839718275840:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788940425.216864:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:2351:x1875839718275840:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 21us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940425.216870:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 236 00000100:00080000:3.0:1788940425.216901:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788940425.708978:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788940425.709004:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b8bf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738235392:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788940425.709093:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940425.709595:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738235392 00000100:00100000:3.0:1788940425.709608:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738235392 00000100:00100000:3.0:1788940425.709691:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788940425.709702:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf97ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738235392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788940425.709745:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788940425.709802:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf97ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738235392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940425.709826:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1788940425.709918:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788940425.709955:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1b8bf7100 x1875839738235392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940441 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940425.709976:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b8bf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738235392:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788940425.901730:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788940426.722485:0:11045:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1788940426.737115:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b500f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3308:1875839738235520:0@lo:400:kworker.0 00000100:00100000:0.0:1788940426.737224:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940426.737453:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738235520 00000100:00100000:3.0:1788940426.737466:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738235520 00000100:00100000:3.0:1788940426.737559:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788940426.737572:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3308:x1875839738235520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940426.738627:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b500f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875839738235648:0@lo:400:kworker.0 00000100:00100000:2.0:1788940426.738699:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940426.738740:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788940426.738748:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b500ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875839738235776:0@lo:400:kworker.0 00000100:00100000:2.0:1788940426.738772:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940426.738875:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738235648 00000100:00100000:2.0:1788940426.738882:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738235648 00000100:00100000:2.0:1788940426.738925:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738235776 00000100:00100000:2.0:1788940426.738928:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738235776 00000100:00100000:2.0:1788940426.738961:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788940426.738969:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae81ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875839738235648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940426.739019:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae81ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875839738235648:12345-0@lo:400:kworker.0 Request processed in 50us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940426.739027:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788940426.739060:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788940426.739066:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae81e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875839738235776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940426.739104:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae81e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875839738235776:12345-0@lo:400:kworker.0 Request processed in 39us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940426.739110:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788940426.739164:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b500ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875839738235776:0@lo:400:kworker.0 00000100:00100000:2.0:1788940426.739174:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b500f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875839738235648:0@lo:400:kworker.0 00000100:00100000:1.0:1788940426.740246:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b500d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738235904:0@lo:400:kworker.0 00000100:00100000:1.0:1788940426.740308:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940426.740351:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788940426.740356:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b500f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875839738236032:0@lo:400:kworker.0 00000100:00100000:1.0:1788940426.740384:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940426.741359:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b500ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738236160:0@lo:400:kworker.0 00000100:00100000:2.0:1788940426.741415:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940426.741819:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738236032 00000100:00100000:2.0:1788940426.741831:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738236032 00000100:00100000:2.0:1788940426.741904:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788940426.741915:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875839738236032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940426.741991:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875839738236032:12345-0@lo:400:kworker.0 Request processed in 77us (1605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940426.741999:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788940426.742063:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b500f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875839738236032:0@lo:400:kworker.0 00000100:00100000:1.0:1788940426.743913:0:7074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738235904 00000100:00100000:1.0:1788940426.743930:0:7074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738235904 00000100:00100000:1.0:1788940426.744010:0:7074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738236160 00000100:00100000:1.0:1788940426.744014:0:7074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738236160 00000100:00100000:1.0:1788940426.744061:0:7074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788940426.744073:0:7074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738235904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940426.744179:0:7074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738235904:12345-0@lo:400:kworker.0 Request processed in 108us (3870us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940426.744187:0:7074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788940426.744206:0:7074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788940426.744213:0:7074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae81ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738236160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940426.744250:0:7074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae81ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738236160:12345-0@lo:400:kworker.0 Request processed in 37us (2834us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940426.744256:0:7074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:2.0:1788940426.744392:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1b500d880 x1875839738235904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940426.744409:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b500d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738235904:0@lo:400:kworker.0 00010000:00080000:2.0:1788940426.744454:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1b500ed80 x1875839738236160/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940426.744465:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b500ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738236160:0@lo:400:kworker.0 00000100:00080000:1.0:1788940426.747632:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788940426.747665:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788940426.749456:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3308:x1875839738235520:12345-0@lo:400:kworker.0 Request processed in 11869us (12214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940426.749481:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788940426.754361:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b500f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3308:1875839738235520:0@lo:400:kworker.0 00010000:00010000:2.0:1788940426.924840:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940427.244822:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b8bf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738236288:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788940427.244900:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940427.245261:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738236288 00000100:00100000:2.0:1788940427.245296:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738236288 00000100:00100000:2.0:1788940427.245401:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788940427.245411:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738236288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788940427.245451:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788940427.245514:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738236288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940427.245547:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:0.0:1788940427.245826:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1b8bf7800 x1875839738236288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940443 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940427.245846:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b8bf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738236288:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788940427.963006:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940428.972958:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940429.998014:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940430.329364:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940430.329428:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940430.329479:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940430.329692:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718276352 00000100:00100000:2.0:1788940430.329706:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718276352 00000100:00100000:2.0:1788940430.329789:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718276480 00000100:00100000:2.0:1788940430.329793:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718276480 00000100:00100000:2.0:1788940430.329823:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 101 00000100:00100000:2.0:1788940430.329833:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b8bf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2353:x1875839718276352:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788940430.329962:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b8bf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2353:x1875839718276352:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 129us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940430.329971:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 101 00000100:00100000:2.0:1788940430.329992:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 102 00000100:00100000:2.0:1788940430.330011:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b8bf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffa310cd-169f-42e3-8999-506116bada08+5:2353:x1875839718276480:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788940430.330038:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b8bf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffa310cd-169f-42e3-8999-506116bada08+5:2353:x1875839718276480:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 40us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940430.330045:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 102 00000100:00080000:2.0:1788940430.330074:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788940430.330170:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718276224 00000100:00100000:0.0:1788940430.330175:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718276224 00000100:00100000:0.0:1788940430.330220:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 238 00000100:00100000:0.0:1788940430.330227:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:2353:x1875839718276224:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788940430.330261:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:2353:x1875839718276224:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 35us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940430.330285:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 238 00000100:00100000:1.0:1788940430.830052:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788940430.830082:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf97f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738236416:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788940430.830195:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940430.830399:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738236416 00000100:00100000:0.0:1788940430.830412:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738236416 00000100:00100000:0.0:1788940430.830507:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788940430.830546:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738236416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788940430.830601:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788940430.830738:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738236416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 220us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940430.830746:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:1.0:1788940430.830839:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788940430.830881:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1bf97f100 x1875839738236416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940446 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940430.830905:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf97f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738236416:0@lo:13:osp-pre-0-0.0 00000020:00000080:0.0:1788940430.903876:0:11194:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffb2ee18a0 20000000:00000080:0.0:1788940430.903906:0:11194:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff89f1aefa7c00 uarg=0000000000000000 20000000:01000000:0.0:1788940430.903957:0:11194:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788940430.903965:0:11194:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788940430.903972:0:11194:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788940430.905931:0:11195:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1788940430.906472:0:11194:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788940430.918257:0:11194:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788940430.919221:0:11194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89f188daae00/0x27a633fcdd4ab8f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940430.919251:0:11194:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89f082ad2600/0x27a633fcdd4ab34 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f56b6 expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940430.919277:0:11194:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89f181521400/0x27a633fcdd4ab42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4ab3b expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940430.919284:0:11194:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89f181520e00/0x27a633fcdd4ab50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4ab49 expref: 18 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940430.919290:0:11194:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89f188daa400/0x27a633fcdd4ab5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4ab57 expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940430.919298:0:11194:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89f1c21f1200/0x27a633fcdd4ab73 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f56ee expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940430.919307:0:11194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89f188daae00/0x27a633fcdd4ab8f lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940430.919363:0:11194:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89f1c21f1200/0x27a633fcdd4ab73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f56ee expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940430.919384:0:11194:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89f1c21f1200/0x27a633fcdd4ab73 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f56ee expref: 12 pid: 5855 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940430.919403:0:11194:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae81e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11194:1875839738236544:192.168.202.14@tcp:104: 00010000:00010000:2.0:1788940430.919596:0:11194:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89f188daa400/0x27a633fcdd4ab5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27a633fcdd4ab57 expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940430.919605:0:11194:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89f188daa400/0x27a633fcdd4ab5e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27a633fcdd4ab57 expref: 18 pid: 5855 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940430.919616:0:11194:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae81c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11194:1875839738236672:0@lo:104: 00000100:00100000:2.0:1788940430.925065:0:11194:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788940430.925208:0:11194:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89f181520e00/0x27a633fcdd4ab50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27a633fcdd4ab49 expref: 18 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940430.925230:0:11194:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89f181520e00/0x27a633fcdd4ab50 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27a633fcdd4ab49 expref: 18 pid: 5854 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940430.925249:0:11194:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae81d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11194:1875839738236800:0@lo:104: 00000100:00100000:2.0:1788940430.925305:0:11194:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940430.925473:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940430.925566:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718276608 00000100:00100000:0.0:1788940430.925577:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718276608 00010000:00010000:0.0:1788940430.925624:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89f1c21f1200/0x27a633fcdd4ab73 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f56ee expref: 13 pid: 5855 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940430.925672:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 25 00000100:00100000:0.0:1788940430.925683:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1841b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:2352:x1875839718276608:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940430.925699:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940430.925706:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89f1c21f1200/0x27a633fcdd4ab73 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f56ee expref: 13 pid: 5855 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940430.925757:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89f1c21f1200/0x27a633fcdd4ab73 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f56ee expref: 13 pid: 5855 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940430.925779:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940430.926023:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1841b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:2352:x1875839718276608:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 154us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940430.926034:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 25 00010000:00010000:2.0:1788940430.931482:0:11194:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89f181521400/0x27a633fcdd4ab42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27a633fcdd4ab3b expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940430.931628:0:11194:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89f181521400/0x27a633fcdd4ab42 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27a633fcdd4ab3b expref: 18 pid: 5855 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940430.931657:0:11194:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b500f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11194:1875839738236928:0@lo:104: 00000100:00100000:2.0:1788940430.931732:0:11194:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940430.936075:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738236672 00000100:00100000:1.0:1788940430.936097:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738236672 00000100:00100000:1.0:1788940430.936194:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738236800 00000100:00100000:1.0:1788940430.936198:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738236800 00000100:00100000:1.0:1788940430.936235:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788940430.936246:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae81d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+4:11194:x1875839738236672:12345-0@lo:104: 00010000:00010000:1.0:1788940430.936285:0:8469:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff89f1829db400/0x27a633fcdd4ab57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4ab5e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940430.936397:0:8530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1788940430.936412:0:8469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788940430.936420:0:8530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae81c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:1220f165-b68f-42ea-b6cd-5f8ad1a18830+4:11194:x1875839738236800:12345-0@lo:104: 00000100:00100000:1.0:1788940430.936422:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae81d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+4:11194:x1875839738236672:12345-0@lo:104: Request processed in 176us (11368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940430.936434:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:0.0:1788940430.936435:0:8530:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff89f181521600/0x27a633fcdd4ab49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4ab50 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940430.936476:0:7650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940430.936487:0:8530:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788940430.936493:0:8530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae81c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:1220f165-b68f-42ea-b6cd-5f8ad1a18830+3:11194:x1875839738236800:12345-0@lo:104: Request processed in 80us (11187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940430.936500:0:8530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1788940430.936956:0:7650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff89f1829db400/0x27a633fcdd4ab57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4ab5e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940430.936969:0:7650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1829db400 already unused, calling callback (ffffffffc1d10c20) 10000000:00010000:1.0:1788940430.936975:0:7650:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff89f1829db400/0x27a633fcdd4ab57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x27a633fcdd4ab5e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940430.936987:0:7650:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff89f1829db400/0x27a633fcdd4ab57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x27a633fcdd4ab5e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788940430.937032:0:7650:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff89f1829db400/0x27a633fcdd4ab57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x27a633fcdd4ab5e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940430.937039:0:7650:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788940430.937093:0:7650:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff89f1829db400/0x27a633fcdd4ab57 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4ab5e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940430.937100:0:7650:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788940430.937127:0:7650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff89f1829db400/0x27a633fcdd4ab57 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4ab5e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940430.937136:0:7650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff89f1829db400/0x27a633fcdd4ab57 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4ab5e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940430.937156:0:7650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940430.937160:0:7650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff89f181521600/0x27a633fcdd4ab49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4ab50 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940430.937166:0:7650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f181521600 already unused, calling callback (ffffffffc1d10c20) 10000000:00010000:1.0:1788940430.937170:0:7650:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff89f181521600/0x27a633fcdd4ab49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x27a633fcdd4ab50 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940430.937178:0:7650:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff89f181521600/0x27a633fcdd4ab49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x27a633fcdd4ab50 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788940430.937184:0:7650:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff89f181521600/0x27a633fcdd4ab49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x27a633fcdd4ab50 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940430.937189:0:7650:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788940430.937210:0:7650:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff89f181521600/0x27a633fcdd4ab49 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4ab50 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940430.937217:0:7650:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788940430.937236:0:7650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff89f181521600/0x27a633fcdd4ab49 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4ab50 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940430.937242:0:7650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff89f181521600/0x27a633fcdd4ab49 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4ab50 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940430.937253:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940430.937254:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940430.937256:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940430.937431:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4f66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3308:1875839738237056:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788940430.937576:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940430.937643:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4f67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3305:1875839738237184:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788940430.937669:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940430.937699:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738237056 00000100:00100000:1.0:1788940430.937705:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738237056 00010000:00010000:1.0:1788940430.937733:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89f188daa400/0x27a633fcdd4ab5e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4ab57 expref: 19 pid: 5855 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940430.937825:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738237184 00000100:00100000:1.0:1788940430.937829:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738237184 00010000:00010000:1.0:1788940430.937844:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89f181520e00/0x27a633fcdd4ab50 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4ab49 expref: 20 pid: 5854 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940430.937871:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788940430.937879:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f66300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+20:3308:x1875839738237056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788940430.937892:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940430.937905:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89f188daa400/0x27a633fcdd4ab5e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4ab57 expref: 20 pid: 5855 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940430.937919:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89f188daa400/0x27a633fcdd4ab5e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27a633fcdd4ab57 expref: 20 pid: 5855 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940430.937944:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940430.937979:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f66300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+20:3308:x1875839738237056:12345-0@lo:103:ldlm_bl.0 Request processed in 100us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940430.937987:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788940430.938016:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788940430.938022:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3305:x1875839738237184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788940430.938030:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940430.938035:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89f181520e00/0x27a633fcdd4ab50 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4ab49 expref: 19 pid: 5854 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940430.938045:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89f181520e00/0x27a633fcdd4ab50 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27a633fcdd4ab49 expref: 19 pid: 5854 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940430.938055:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940430.938080:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3305:x1875839738237184:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940430.938087:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788940430.938127:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4f67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3305:1875839738237184:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788940430.938155:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4f66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3308:1875839738237056:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788940430.945186:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738236928 00000100:00100000:3.0:1788940430.945212:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738236928 00010000:00010000:2.0:1788940430.945258:0:11194:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89f082ad2600/0x27a633fcdd4ab34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f56b6 expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940430.945284:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788940430.945295:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b500ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+3:11194:x1875839738236928:12345-0@lo:104: 00010000:00010000:2.0:1788940430.945893:0:11194:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89f082ad2600/0x27a633fcdd4ab34 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f56b6 expref: 12 pid: 5855 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940430.945912:0:11194:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b500d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11194:1875839738237312:192.168.202.14@tcp:104: 00000100:00100000:2.0:1788940430.946052:0:11194:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1a94ffb40 going to sleep for 11 seconds 00010000:00010000:2.0:1788940430.946088:0:11194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f1c21f1200/0x27a633fcdd4ab73 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f56ee expref: 12 pid: 5855 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940430.946106:0:11194:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae81e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11194:1875839738236544:192.168.202.14@tcp:104: 00010000:00010000:2.0:1788940430.946142:0:11194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f188daa400/0x27a633fcdd4ab5e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27a633fcdd4ab57 expref: 18 pid: 5855 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940430.946152:0:11194:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae81c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11194:1875839738236672:0@lo:104: 00010000:00010000:2.0:1788940430.946163:0:11194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f181520e00/0x27a633fcdd4ab50 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27a633fcdd4ab49 expref: 17 pid: 5854 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940430.946173:0:11194:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae81d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11194:1875839738236800:0@lo:104: 00010000:00010000:3.0:1788940430.946541:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff89f082ad3c00/0x27a633fcdd4ab3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4ab42 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940430.946963:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940430.948103:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788940430.948121:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b500ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+3:11194:x1875839738236928:12345-0@lo:104: Request processed in 2823us (16383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940430.948135:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788940430.948180:0:11194:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b500f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11194:1875839738236928:0@lo:104: 00010000:00010000:0.0:1788940430.948644:0:5848:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940430.948656:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff89f082ad3c00/0x27a633fcdd4ab3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4ab42 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940430.948668:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad3c00 already unused, calling callback (ffffffffc1d10c20) 10000000:00010000:0.0:1788940430.948673:0:5848:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff89f082ad3c00/0x27a633fcdd4ab3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x27a633fcdd4ab42 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940430.948684:0:5848:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff89f082ad3c00/0x27a633fcdd4ab3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x27a633fcdd4ab42 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788940430.948782:0:5848:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff89f082ad3c00/0x27a633fcdd4ab3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x27a633fcdd4ab42 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940430.948791:0:5848:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788940430.949672:0:5848:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff89f082ad3c00/0x27a633fcdd4ab3b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4ab42 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940430.949684:0:5848:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788940430.949785:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf97f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3306:1875839738237440:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788940430.949856:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788940430.949918:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff89f082ad3c00/0x27a633fcdd4ab3b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4ab42 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940430.949930:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff89f082ad3c00/0x27a633fcdd4ab3b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4ab42 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940430.949956:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940430.949958:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940430.949960:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940430.955626:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738237440 00000100:00100000:1.0:1788940430.955645:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738237440 00010000:00010000:1.0:1788940430.955703:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89f181521400/0x27a633fcdd4ab42 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4ab3b expref: 17 pid: 5855 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940430.955782:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788940430.955793:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b500f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+17:3306:x1875839738237440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788940430.955814:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940430.955820:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89f181521400/0x27a633fcdd4ab42 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4ab3b expref: 17 pid: 5855 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940430.955835:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89f181521400/0x27a633fcdd4ab42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27a633fcdd4ab3b expref: 17 pid: 5855 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940430.955859:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f181521400/0x27a633fcdd4ab42 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27a633fcdd4ab3b expref: 17 pid: 5855 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940430.955883:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940430.955965:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b500f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+16:3306:x1875839738237440:12345-0@lo:103:ldlm_bl.0 Request processed in 174us (6108us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940430.955972:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788940430.956173:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf97f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3306:1875839738237440:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788940430.960461:0:11194:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b500d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11194:1875839738237312:192.168.202.14@tcp:104: 00010000:00010000:1.0:1788940430.960562:0:11194:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89f188daae00/0x27a633fcdd4ab8f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940430.968006:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940430.968307:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718276736 00000100:00100000:3.0:1788940430.968342:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718276736 00010000:00010000:3.0:1788940430.968392:0:8470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89f082ad2600/0x27a633fcdd4ab34 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f56b6 expref: 12 pid: 5855 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940430.968453:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 29 00000100:00100000:3.0:1788940430.968465:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf97fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0b05a86-29c8-44a6-9c64-75d9d650043e+12:2353:x1875839718276736:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940430.968483:0:8470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940430.968489:0:8470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89f082ad2600/0x27a633fcdd4ab34 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f56b6 expref: 12 pid: 5855 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940430.968506:0:8470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89f082ad2600/0x27a633fcdd4ab34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f56b6 expref: 12 pid: 5855 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940430.968693:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f082ad2600/0x27a633fcdd4ab34 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f56b6 expref: 12 pid: 5855 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940430.968728:0:8470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89f188daae00/0x27a633fcdd4ab8f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940430.968739:0:8470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f188daae00/0x27a633fcdd4ab8f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940430.968759:0:8470:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89f188daae00/0x27a633fcdd4ab8f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940430.968766:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89f188daae00/0x27a633fcdd4ab8f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940430.968773:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89f188daae00/0x27a633fcdd4ab8f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940430.968791:0:8470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89f188daae00/0x27a633fcdd4ab8f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940430.968798:0:8470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188daae00 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:3.0:1788940430.968802:0:8470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89f188daae00/0x27a633fcdd4ab8f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940430.968811:0:8470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89f188daae00/0x27a633fcdd4ab8f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940430.968892:0:11194:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89f188daae00/0x27a633fcdd4ab8f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940430.968904:0:11194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89f188daae00/0x27a633fcdd4ab8f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940430.968935:0:8470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89f188daae00/0x27a633fcdd4ab8f lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940430.968947:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f188daae00/0x27a633fcdd4ab8f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940430.968967:0:8470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940430.969050:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf97fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0b05a86-29c8-44a6-9c64-75d9d650043e+11:2353:x1875839718276736:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 586us (1070us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940430.969059:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 29 00010000:00010000:3.0:1788940431.022429:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940431.853508:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b8bf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875839738237824:0@lo:400:kworker.0 00000100:00100000:3.0:1788940431.853653:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940431.854035:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788940431.854044:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b8bf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738237952:0@lo:400:kworker.0 00000100:00100000:3.0:1788940431.854080:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940431.854445:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b8bf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3307:1875839738237568:0@lo:400:kworker.0 00000100:00100000:1.0:1788940431.854557:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940431.854696:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b8bf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875839738238080:0@lo:400:kworker.0 00000100:00100000:1.0:1788940431.854838:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940431.854866:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788940431.854873:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b8bf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875839738237696:0@lo:400:kworker.0 00000100:00100000:3.0:1788940431.855266:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738237824 00000100:00100000:3.0:1788940431.855277:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738237824 00000100:00100000:3.0:1788940431.855366:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738238080 00000100:00100000:3.0:1788940431.855370:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738238080 00000100:00100000:3.0:1788940431.855409:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788940431.855419:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b8bf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875839738237824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940431.855497:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b8bf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875839738237824:12345-0@lo:400:kworker.0 Request processed in 79us (1843us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940431.855505:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788940431.855562:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788940431.855569:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875839738238080:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788940431.855773:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788940431.855793:0:7074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738237952 00000100:00100000:0.0:1788940431.855798:0:7074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738237952 00000100:00100000:0.0:1788940431.855838:0:7074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788940431.855845:0:7074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b8bf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738237952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940431.856178:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940431.868341:0:7074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b8bf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738237952:12345-0@lo:400:kworker.0 Request processed in 12475us (14238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940431.868366:0:7074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788940431.868465:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738237568 00000100:00100000:0.0:1788940431.868477:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738237568 00000100:00100000:0.0:1788940431.868562:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788940431.868588:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+16:3307:x1875839738237568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940431.868656:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+16:3307:x1875839738237568:12345-0@lo:400:kworker.0 Request processed in 71us (14099us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940431.868663:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788940431.868796:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738237696 00000100:00100000:0.0:1788940431.868802:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738237696 00000100:00100000:0.0:1788940431.868830:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788940431.868837:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875839738237696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940431.868893:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875839738237696:12345-0@lo:400:kworker.0 Request processed in 57us (13994us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940431.868910:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00080000:2.0:1788940431.869509:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1b8bf4000 x1875839738237952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940431.869653:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b8bf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738237952:0@lo:400:kworker.0 00000100:00100000:2.0:1788940431.869676:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b8bf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875839738237824:0@lo:400:kworker.0 00000100:00100000:1.0:1788940431.878188:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b8bf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875839738237696:0@lo:400:kworker.0 00000100:00100000:1.0:1788940431.878210:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b8bf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738238208:0@lo:400:kworker.0 00000100:00100000:1.0:1788940431.878292:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940431.878336:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b8bf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3307:1875839738237568:0@lo:400:kworker.0 00000100:00100000:1.0:1788940431.878353:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b8bf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875839738238080:0@lo:400:kworker.0 00000100:00100000:2.0:1788940431.879611:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738238208 00000100:00100000:2.0:1788940431.879626:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738238208 00000100:00100000:2.0:1788940431.879728:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788940431.879741:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738238208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940431.879842:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738238208:12345-0@lo:400:kworker.0 Request processed in 104us (1549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940431.879850:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:2.0:1788940431.879879:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788940431.882108:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1b8bf4a80 x1875839738238208/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940431.882132:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b8bf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738238208:0@lo:400:kworker.0 00000100:00100000:3.0:1788940431.891274:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875839738238080:12345-0@lo:400:kworker.0 Request processed in 35687us (36416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940431.891298:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788940431.997173:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940431.997259:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718276864 00000100:00100000:3.0:1788940431.997272:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718276864 00000100:00100000:3.0:1788940431.997346:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 240 00000100:00100000:3.0:1788940431.997357:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+11:5599:x1875839718276864:12345-192.168.202.14@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788940431.997382:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940431.997416:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f1c21f1000/0x27a633fcdd4ab96 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5718 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940431.997457:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f1c21f1000/0x27a633fcdd4ab96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5718 expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940431.997471:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f1c21f1000/0x27a633fcdd4ab96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5718 expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940431.997482:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f1c21f1000, rc 0) 00000100:00100000:3.0:1788940431.997580:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+12:5599:x1875839718276864:12345-192.168.202.14@tcp:101:ll_cfg_requeue.0 Request processed in 225us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940431.997606:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 240 00000100:00100000:0.0:1788940432.000147:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940432.000196:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718276992 00000100:00100000:0.0:1788940432.000209:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718276992 00000100:00100000:0.0:1788940432.000282:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 241 00000100:00100000:0.0:1788940432.000295:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0b05a86-29c8-44a6-9c64-75d9d650043e+12:5599:x1875839718276992:12345-192.168.202.14@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788940432.000808:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0b05a86-29c8-44a6-9c64-75d9d650043e+12:5599:x1875839718276992:12345-192.168.202.14@tcp:501:ll_cfg_requeue.0 Request processed in 513us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940432.000820:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 241 00000100:00100000:3.0:1788940432.004051:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940432.006770:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718277120 00000100:00100000:0.0:1788940432.006798:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718277120 00000100:00100000:0.0:1788940432.006905:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 242 00000100:00100000:0.0:1788940432.006919:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0b05a86-29c8-44a6-9c64-75d9d650043e+12:5599:x1875839718277120:12345-192.168.202.14@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788940432.007263:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0b05a86-29c8-44a6-9c64-75d9d650043e+12:5599:x1875839718277120:12345-192.168.202.14@tcp:503:ll_cfg_requeue.0 Request processed in 347us (3224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940432.007282:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 242 00000100:00100000:0.0:1788940432.024882:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940432.025158:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718277248 00000100:00100000:3.0:1788940432.025171:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718277248 00000100:00100000:3.0:1788940432.025350:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 243 00000100:00100000:3.0:1788940432.025375:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18416d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+12:5599:x1875839718277248:12345-192.168.202.14@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788940432.025401:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940432.025429:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f1c21f0200/0x27a633fcdd4ab9d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f571f expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940432.025489:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f1c21f0200/0x27a633fcdd4ab9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f571f expref: 13 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940432.025505:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f1c21f0200/0x27a633fcdd4ab9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f571f expref: 13 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940432.030081:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f1c21f0200, rc 0) 00000100:00100000:3.0:1788940432.030216:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18416d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:5599:x1875839718277248:12345-192.168.202.14@tcp:101:ll_cfg_requeue.0 Request processed in 4835us (5349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940432.030239:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 243 00000100:00100000:0.0:1788940432.033946:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940432.034029:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718277376 00000100:00100000:1.0:1788940432.034043:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718277376 00000100:00100000:1.0:1788940432.034188:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 244 00000100:00100000:1.0:1788940432.034203:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18416f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:5599:x1875839718277376:12345-192.168.202.14@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788940432.034678:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18416f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:5599:x1875839718277376:12345-192.168.202.14@tcp:501:ll_cfg_requeue.0 Request processed in 477us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940432.034689:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 244 00000100:00100000:0.0:1788940432.048128:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00010000:00010000:2.0:1788940432.048358:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940432.048806:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718277504 00000100:00100000:3.0:1788940432.048821:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718277504 00000100:00100000:3.0:1788940432.048902:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 245 00000100:00100000:3.0:1788940432.048914:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18416e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:5599:x1875839718277504:12345-192.168.202.14@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788940432.049258:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18416e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:5599:x1875839718277504:12345-192.168.202.14@tcp:503:ll_cfg_requeue.0 Request processed in 344us (1142us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940432.049279:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 245 00000100:00100000:1.0:1788940432.374747:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf97ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738238336:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788940432.374957:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940432.382760:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738238336 00000100:00100000:2.0:1788940432.382786:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738238336 00000100:00100000:3.0:1788940432.388780:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788940432.388799:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae81d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738238336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788940432.389115:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788940432.389245:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae81d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738238336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 449us (14287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940432.389254:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1788940432.389474:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1bf97ed80 x1875839738238336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940448 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940432.389503:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf97ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738238336:0@lo:13:osp-pre-1-0.0 10000000:01000000:1.0:1788940432.877913:0:5858:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788940432.877926:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89f1bf721000 from 7 10000000:01000000:1.0:1788940432.877934:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788940432.878015:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f19258ce00/0x27a633fcdd4aba4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940432.878032:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f19258ce00/0x27a633fcdd4aba4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940432.878048:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f19258ce00/0x27a633fcdd4aba4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940432.878101:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae81c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738238464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788940432.878219:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940432.878289:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f184151000 going to sleep for 11 seconds 00000100:00100000:1.0:1788940432.880806:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738238464 00000100:00100000:1.0:1788940432.880828:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738238464 00000100:00100000:1.0:1788940432.880912:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1788940432.880924:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18416f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+16:5858:x1875839738238464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788940432.880946:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940432.880970:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f19258d800/0x27a633fcdd4abab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4aba4 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940432.881017:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f19258d800/0x27a633fcdd4abab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4aba4 expref: 17 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940432.881032:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f19258d800/0x27a633fcdd4abab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4aba4 expref: 17 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940432.881043:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f19258d800, rc 0) 00000100:00100000:1.0:1788940432.882888:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18416f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+17:5858:x1875839738238464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1953us (4656us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940432.882921:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1788940432.883045:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae81c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738238464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788940432.883074:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f19258ce00/0x27a633fcdd4aba4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4abab expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940432.885672:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f19258ce00/0x27a633fcdd4aba4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4abab expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940432.885809:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae81c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738238592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788940432.885900:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940432.888706:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f184151000 going to sleep for 11 seconds 00000100:00100000:1.0:1788940432.888964:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738238592 00000100:00100000:1.0:1788940432.888985:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738238592 00000100:00100000:1.0:1788940432.889047:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1788940432.889058:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18416ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+17:5858:x1875839738238592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788940432.889583:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18416ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+17:5858:x1875839738238592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 523us (3680us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940432.889592:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1788940432.889669:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae81c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738238592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788940432.889739:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae81c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738238720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788940432.889794:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940432.889827:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f184151000 going to sleep for 11 seconds 00000100:00100000:1.0:1788940432.889842:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738238720 00000100:00100000:1.0:1788940432.889846:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738238720 00000100:00100000:1.0:1788940432.889875:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1788940432.889891:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18416dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+17:5858:x1875839738238720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788940432.904785:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18416dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+17:5858:x1875839738238720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 14873us (14970us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940432.904810:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1788940432.905064:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae81c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738238720:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788940432.906757:0:11232:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788940432.911274:0:5858:0:(obd_config.c:2244:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788940432.911340:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788940432.911361:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f19258ce00/0x27a633fcdd4aba4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4abab expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940432.911377:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f19258ce00/0x27a633fcdd4aba4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4abab expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940432.911392:0:5858:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788940432.911397:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89f19016d800 from 7 10000000:01000000:1.0:1788940432.911400:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788940432.911462:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f19258d200/0x27a633fcdd4abb2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940432.911472:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f19258d200/0x27a633fcdd4abb2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940432.911486:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f19258d200/0x27a633fcdd4abb2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940432.911547:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae81e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738238848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788940432.911666:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940432.911725:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f184151480 going to sleep for 11 seconds 00000100:00100000:2.0:1788940432.912743:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738238848 00000100:00100000:2.0:1788940432.912761:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738238848 00000100:00100000:2.0:1788940432.912839:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1788940432.912850:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18416c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+17:5858:x1875839738238848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788940432.912870:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940432.912892:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f188daa000/0x27a633fcdd4abb9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4abb2 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940432.912928:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f188daa000/0x27a633fcdd4abb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4abb2 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940432.912943:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f188daa000/0x27a633fcdd4abb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4abb2 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940432.912954:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f188daa000, rc 0) 00000100:00100000:2.0:1788940432.913048:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18416c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+18:5858:x1875839738238848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 199us (1382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940432.913056:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1788940432.913133:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae81e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738238848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788940432.913154:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f19258d200/0x27a633fcdd4abb2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4abb9 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940432.913165:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f19258d200/0x27a633fcdd4abb2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4abb9 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940432.913251:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b500d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738238976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788940432.913282:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940432.913318:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1a94ff540 going to sleep for 11 seconds 00000100:00100000:2.0:1788940432.913335:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738238976 00000100:00100000:2.0:1788940432.913340:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738238976 00000100:00100000:2.0:1788940432.913363:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1788940432.913369:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18416e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+18:5858:x1875839738238976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788940432.913947:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18416e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+18:5858:x1875839738238976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 575us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940432.913957:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1788940432.914014:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b500d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738238976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788940432.914054:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b500d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738239104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788940432.916251:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940432.916314:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1a94ff540 going to sleep for 11 seconds 00000100:00100000:2.0:1788940432.916582:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738239104 00000100:00100000:2.0:1788940432.916593:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738239104 00000100:00100000:2.0:1788940432.916665:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1788940432.916675:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18416c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+18:5858:x1875839738239104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788940432.916948:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18416c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+18:5858:x1875839738239104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 274us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940432.916957:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1788940432.917033:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b500d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738239104:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788940432.922601:0:11234:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788940432.922701:0:5858:0:(obd_config.c:2244:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788940432.922732:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788940432.922746:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f19258d200/0x27a633fcdd4abb2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4abb9 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940432.922760:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f19258d200/0x27a633fcdd4abb2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4abb9 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940432.922791:0:5858:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788940432.922794:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89f188f09000 from 7 10000000:01000000:2.0:1788940432.922798:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788940432.922851:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f188dab000/0x27a633fcdd4abc0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940432.922860:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f188dab000/0x27a633fcdd4abc0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940432.922874:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f188dab000/0x27a633fcdd4abc0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940432.922913:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b500d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738239232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788940432.923022:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940432.923057:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1a94ffa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788940432.924705:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738239232 00000100:00100000:3.0:1788940432.924724:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738239232 00000100:00100000:3.0:1788940432.924791:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788940432.924800:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18416e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+18:5858:x1875839738239232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788940432.924821:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940432.924844:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f1c21f1e00/0x27a633fcdd4abc7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4abc0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940432.924881:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f1c21f1e00/0x27a633fcdd4abc7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4abc0 expref: 19 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940432.924894:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f1c21f1e00/0x27a633fcdd4abc7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4abc0 expref: 19 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940432.924904:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f1c21f1e00, rc 0) 00000100:00100000:3.0:1788940432.925002:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18416e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:5858:x1875839738239232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 202us (1979us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940432.925008:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788940432.925105:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b500d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738239232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788940432.925126:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f188dab000/0x27a633fcdd4abc0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4abc7 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940432.925138:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f188dab000/0x27a633fcdd4abc0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4abc7 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940432.925220:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b8bf4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738239360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788940432.925250:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940432.925268:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f195ed3600 going to sleep for 11 seconds 00000100:00100000:3.0:1788940432.925279:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738239360 00000100:00100000:3.0:1788940432.925282:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738239360 00000100:00100000:3.0:1788940432.925298:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1788940432.925303:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18416fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:5858:x1875839738239360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788940432.925657:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18416fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:5858:x1875839738239360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 351us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940432.925664:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1788940432.925693:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b8bf4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738239360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788940432.925721:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b8bf4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738239488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788940432.925758:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940432.925770:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f195ed3600 going to sleep for 11 seconds 00000100:00100000:3.0:1788940432.925781:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738239488 00000100:00100000:3.0:1788940432.925785:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738239488 00000100:00100000:3.0:1788940432.925803:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1788940432.925809:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18416d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:5858:x1875839738239488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788940432.925957:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18416d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:5858:x1875839738239488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 147us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940432.925969:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1788940432.926014:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b8bf4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738239488:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788940432.929014:0:11235:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788940432.930152:0:5858:0:(obd_config.c:2244:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788940432.930197:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788940432.930212:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f188dab000/0x27a633fcdd4abc0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4abc7 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940432.930229:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f188dab000/0x27a633fcdd4abc0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4abc7 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940433.068775:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940434.104067:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940435.116687:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940435.450676:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940435.450723:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940435.450746:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940435.450787:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718277632 00000100:00100000:3.0:1788940435.450801:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718277632 00000100:00100000:3.0:1788940435.450862:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 255 00000100:00100000:3.0:1788940435.450873:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18416cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:2352:x1875839718277632:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788940435.450964:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18416cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:2352:x1875839718277632:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 80us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940435.450973:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 255 00000100:00100000:3.0:1788940435.451120:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718277760 00000100:00100000:3.0:1788940435.451124:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718277760 00000100:00100000:3.0:1788940435.451221:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718277888 00000100:00100000:3.0:1788940435.451225:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718277888 00000100:00100000:3.0:1788940435.451250:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 106 00000100:00100000:3.0:1788940435.451257:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b8bf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2352:x1875839718277760:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788940435.451318:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b8bf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2352:x1875839718277760:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 61us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940435.451324:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 106 00000100:00100000:3.0:1788940435.451338:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 107 00000100:00100000:3.0:1788940435.451344:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b8bf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffa310cd-169f-42e3-8999-506116bada08+5:2352:x1875839718277888:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788940435.451368:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b8bf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffa310cd-169f-42e3-8999-506116bada08+5:2352:x1875839718277888:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 25us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940435.451374:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 107 00000100:00080000:3.0:1788940435.451393:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940435.948882:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788940435.948912:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae81e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738239616:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788940435.948996:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940435.949071:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738239616 00000100:00100000:1.0:1788940435.949080:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738239616 00000100:00100000:1.0:1788940435.949144:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788940435.949154:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae81c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738239616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788940435.949191:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788940435.949243:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae81c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738239616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940435.949251:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1788940435.949277:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788940435.949312:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1ae81e680 x1875839738239616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940451 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940435.949332:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae81e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738239616:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1788940436.070850:0:11391:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg214-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788940436.141853:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940436.972769:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b8bf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3307:1875839738239744:0@lo:400:kworker.0 00000100:00100000:3.0:1788940436.972802:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b8bf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738240128:0@lo:400:kworker.0 00000100:00100000:0.0:1788940436.972874:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b8bf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875839738239872:0@lo:400:kworker.0 00000100:00100000:2.0:1788940436.972975:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b8bf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875839738240000:0@lo:400:kworker.0 00000100:00100000:1.0:1788940436.977228:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940436.981376:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf69df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875839738240256:0@lo:400:kworker.0 00000100:00100000:1.0:1788940436.981479:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940436.981570:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940436.981616:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738240256 00000100:00100000:3.0:1788940436.981626:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738240256 00000100:00100000:1.0:1788940436.981626:0:7074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738240128 00000100:00100000:1.0:1788940436.981630:0:7074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738240128 00000100:00100000:3.0:1788940436.981678:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788940436.981678:0:7074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788940436.981687:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae81e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875839738240256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940436.981687:0:7074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf69c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738240128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940436.981741:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae81e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875839738240256:12345-0@lo:400:kworker.0 Request processed in 57us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940436.981741:0:7074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf69c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738240128:12345-0@lo:400:kworker.0 Request processed in 54us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940436.981748:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788940436.981748:0:7074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788940436.981774:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738239744 00000100:00100000:3.0:1788940436.981777:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738239744 00000100:00080000:1.0:1788940436.981780:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788940436.981798:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788940436.981804:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f188d36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3307:x1875839738239744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940436.981813:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf69df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875839738240256:0@lo:400:kworker.0 00000100:00100000:3.0:1788940436.981833:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f188d36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3307:x1875839738239744:12345-0@lo:400:kworker.0 Request processed in 30us (4616us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940436.981835:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b8bf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3307:1875839738239744:0@lo:400:kworker.0 00000100:00100000:3.0:1788940436.981840:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00010000:00080000:3.0:1788940436.981884:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1b8bf4000 x1875839738240128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940436.982116:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b8bf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738240128:0@lo:400:kworker.0 00000100:00100000:0.0:1788940436.986614:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940436.986695:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf69d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738240384:0@lo:400:kworker.0 00000100:00100000:0.0:1788940436.986752:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940436.986921:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738239872 00000100:00100000:3.0:1788940436.986933:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738239872 00000100:00100000:3.0:1788940436.987004:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788940436.987015:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf97ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875839738239872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940436.987083:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf97ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875839738239872:12345-0@lo:400:kworker.0 Request processed in 69us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940436.987091:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788940436.987191:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b8bf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875839738239872:0@lo:400:kworker.0 00000100:00100000:1.0:1788940436.987269:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738240384 00000100:00100000:1.0:1788940436.987273:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738240384 00000100:00100000:3.0:1788940436.987657:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788940436.987668:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf97ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738240384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940436.987717:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf97ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738240384:12345-0@lo:400:kworker.0 Request processed in 52us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940436.987723:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:0.0:1788940436.987873:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788940436.987901:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1bf69d880 x1875839738240384/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940436.987913:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf69d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738240384:0@lo:400:kworker.0 00000100:00100000:2.0:1788940436.990501:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940436.990814:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738240000 00000100:00100000:3.0:1788940436.990827:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738240000 00000100:00100000:3.0:1788940436.990905:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788940436.990916:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b500f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875839738240000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940436.991003:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b500f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875839738240000:12345-0@lo:400:kworker.0 Request processed in 89us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940436.991009:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:2.0:1788940436.992552:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940436.992631:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b8bf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875839738240000:0@lo:400:kworker.0 00010000:00010000:2.0:1788940437.165413:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940437.488315:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788940437.488353:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf97e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738240512:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788940437.488467:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940437.488660:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738240512 00000100:00100000:1.0:1788940437.488670:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738240512 00000100:00100000:1.0:1788940437.488740:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788940437.488751:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf69dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738240512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788940437.488799:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788940437.488863:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf69dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738240512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940437.488871:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:0.0:1788940437.489407:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1bf97e300 x1875839738240512/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940453 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940437.489431:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf97e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738240512:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788940438.196099:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940439.213006:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940440.237698:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940440.569115:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940440.569168:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940440.569201:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940440.569238:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718278144 00000100:00100000:3.0:1788940440.569249:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718278144 00000100:00100000:3.0:1788940440.569309:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718278272 00000100:00100000:3.0:1788940440.569311:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718278272 00000100:00100000:3.0:1788940440.569332:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 111 00000100:00100000:3.0:1788940440.569342:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf69ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2353:x1875839718278144:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788940440.569427:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf69ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2353:x1875839718278144:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 87us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940440.569434:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 111 00000100:00100000:3.0:1788940440.569452:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 112 00000100:00100000:3.0:1788940440.569457:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf69f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffa310cd-169f-42e3-8999-506116bada08+5:2353:x1875839718278272:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788940440.569491:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf69f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffa310cd-169f-42e3-8999-506116bada08+5:2353:x1875839718278272:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 34us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940440.569497:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 112 00000100:00100000:1.0:1788940440.569789:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718278016 00000100:00100000:1.0:1788940440.569796:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718278016 00000100:00100000:1.0:1788940440.569830:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 257 00000100:00100000:1.0:1788940440.569837:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f188d37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:2353:x1875839718278016:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788940440.569875:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f188d37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:2353:x1875839718278016:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 38us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940440.569882:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 257 00000100:00080000:2.0:1788940440.570186:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:0.0:1788940440.717430:0:11491:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 03:53:59 (1788940439) === 00000100:00100000:3.0:1788940441.038272:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940441.041650:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940441.041830:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718278400 00000100:00100000:3.0:1788940441.042597:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718278400 00000100:00100000:3.0:1788940441.042986:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 14 00000100:00100000:3.0:1788940441.043001:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf69f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2353:x1875839718278400:12345-192.168.202.14@tcp:41:mkdir.0 00000004:00000024:3.0:1788940441.043072:0:7857:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788940441.043228:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf69f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2353:x1875839718278400:12345-192.168.202.14@tcp:41:mkdir.0 Request processed in 230us (4976us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940441.043256:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 14 00000100:00100000:0.0:1788940441.049274:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718278528 00000100:00100000:0.0:1788940441.049293:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718278528 00000100:00100000:2.0:1788940441.051628:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 0 00000100:00100000:2.0:1788940441.052651:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf69fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:9692:x1875839718278528:12345-192.168.202.14@tcp:700:mkdir.0 00000100:00100000:2.0:1788940441.053158:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf69fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:9692:x1875839718278528:12345-192.168.202.14@tcp:700:mkdir.0 Request processed in 1509us (11519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940441.053181:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 0 00000100:00100000:3.0:1788940441.064585:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940441.064706:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718278784 00000100:00100000:1.0:1788940441.064721:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718278784 00000100:00100000:1.0:1788940441.064795:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 15 00000100:00100000:1.0:1788940441.064808:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf69ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:9692:x1875839718278784:12345-192.168.202.14@tcp:36:mkdir.0 00010000:00010000:1.0:1788940441.064908:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940441.068244:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829da800/0x27a633fcdd4aaaf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f56a1 expref: 6 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.068287:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f18a6cec00) 00010000:00010000:1.0:1788940441.068331:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788940441.072302:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4abce lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.072327:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4abce lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.072341:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4abce lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.072356:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4abd5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.072363:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4abd5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.072370:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4abd5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940441.072849:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788940441.072880:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b500d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738240640:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788940441.072979:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940441.073055:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738240640 00000100:00100000:2.0:1788940441.073064:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738240640 00000100:00100000:2.0:1788940441.073127:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788940441.073138:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f184195500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738240640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788940441.073189:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788940441.073242:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f184195500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738240640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940441.073249:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1788940441.073281:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788940441.073316:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1b500d880 x1875839738240640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940457 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940441.073340:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b500d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738240640:0@lo:13:osp-pre-0-0.0 00000004:00200000:1.0:1788940441.077728:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788940441.077749:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4abce lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.077760:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4abce lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.077769:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4abce lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.077787:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258c400 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940441.077793:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4abce lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.077803:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4abce lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.077824:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f188f81c00) 00010000:00010000:1.0:1788940441.077827:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940441.077832:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4abce lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.077839:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4abce lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788940441.077864:0:5861:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f448efd8 reply state 0000000048283cc0 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4abd5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940441.077875:0:5861:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788940441.078029:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf69ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+7:9692:x1875839718278784:12345-192.168.202.14@tcp:36:mkdir.0 Request processed in 13220us (13456us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788940441.078041:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 15 00010000:00010000:1.0:1788940441.082192:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4abd5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.082213:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4abd5 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.082220:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4abd5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.082246:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258c000 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940441.082250:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4abd5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.082258:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4abd5 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.082277:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff89f188f81100) 00010000:00010000:1.0:1788940441.082280:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940441.082286:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4abd5 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.082292:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4abd5 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940441.099457:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940441.099769:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718278912 00000100:00100000:1.0:1788940441.099788:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718278912 00000100:00100000:1.0:1788940441.099891:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 16 00000100:00100000:1.0:1788940441.099913:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf69ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:9693:x1875839718278912:12345-192.168.202.14@tcp:101:chmod.0 00010000:00010000:1.0:1788940441.099936:0:7857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940441.099961:0:7857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4abdc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5726 expref: -99 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.100044:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4abe3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.100058:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4abe3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.100080:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4abe3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940441.100136:0:7857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788940441.100140:0:7857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788940441.100188:0:7857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4abe3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.100219:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4abdc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5726 expref: 8 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.100243:0:7857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4abe3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5726 expref: 7 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.100252:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f188f81100) 00010000:00010000:1.0:1788940441.100256:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788940441.100260:0:7857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f19258c400, rc 0) 00000100:00100000:1.0:1788940441.100342:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf69ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+7:9693:x1875839718278912:12345-192.168.202.14@tcp:101:chmod.0 Request processed in 432us (900us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940441.100350:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 16 00000100:00100000:3.0:1788940441.102795:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940441.102946:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718279168 00000100:00100000:0.0:1788940441.102965:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718279168 00000100:00100000:0.0:1788940441.103060:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 17 00000100:00100000:0.0:1788940441.103076:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf69e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+7:9693:x1875839718279168:12345-192.168.202.14@tcp:36:chmod.0 00010000:00010000:0.0:1788940441.103153:0:5862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940441.103192:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4abe3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5726 expref: 7 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940441.103214:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f188f81100) 00010000:00010000:0.0:1788940441.103229:0:5862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788940441.103277:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3200/0x27a633fcdd4abea lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940441.103294:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3200/0x27a633fcdd4abea lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940441.103308:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3200/0x27a633fcdd4abea lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788940441.103947:0:5862:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c2e63479 reply state 00000000fd566fc9 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3200/0x27a633fcdd4abea lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940441.103961:0:5862:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788940441.103973:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788940441.104095:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf69e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+8:9693:x1875839718279168:12345-192.168.202.14@tcp:36:chmod.0 Request processed in 1019us (1314us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788940441.104114:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 17 00010000:00010000:0.0:1788940441.107056:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3200/0x27a633fcdd4abea lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940441.107081:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3200/0x27a633fcdd4abea lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940441.107090:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3200/0x27a633fcdd4abea lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940441.107097:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad3200 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:0.0:1788940441.107102:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3200/0x27a633fcdd4abea lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940441.107112:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3200/0x27a633fcdd4abea lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940441.107131:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f1983af100) 00010000:00010000:0.0:1788940441.107134:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788940441.107140:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3200/0x27a633fcdd4abea lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940441.107147:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3200/0x27a633fcdd4abea lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940441.128621:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940441.134376:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718279296 00000100:00100000:1.0:1788940441.134400:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718279296 00000100:00100000:1.0:1788940441.134677:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 18 00000100:00100000:1.0:1788940441.134693:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf69ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+7:9694:x1875839718279296:12345-192.168.202.14@tcp:101:chown.0 00010000:00010000:1.0:1788940441.134731:0:7857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940441.134766:0:7857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4abf1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f572d expref: -99 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.134881:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4abf8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.134930:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4abf8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.134943:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4abf8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940441.134985:0:7857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788940441.134990:0:7857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788940441.135100:0:7857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4abf8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.135129:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4abf1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f572d expref: 9 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.135152:0:7857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4abf8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f572d expref: 8 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.135161:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f188f81c00) 00010000:00010000:1.0:1788940441.135164:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788940441.135169:0:7857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f19258d000, rc 0) 00000100:00100000:1.0:1788940441.135255:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf69ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+8:9694:x1875839718279296:12345-192.168.202.14@tcp:101:chown.0 Request processed in 567us (6649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940441.135263:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 18 00000100:00100000:2.0:1788940441.145416:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940441.149046:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718279424 00000100:00100000:3.0:1788940441.149067:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718279424 00000100:00100000:3.0:1788940441.149166:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 19 00000100:00100000:3.0:1788940441.149180:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b500d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+8:9694:x1875839718279424:12345-192.168.202.14@tcp:101:chown.0 00010000:00010000:3.0:1788940441.149208:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940441.149238:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f1c21f0e00/0x27a633fcdd4abff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5734 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.149319:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1c21f0a00/0x27a633fcdd4ac06 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.149334:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f1c21f0a00/0x27a633fcdd4ac06 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.149345:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f1c21f0a00/0x27a633fcdd4ac06 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.149360:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1c21f0600/0x27a633fcdd4ac0d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.149367:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f1c21f0600/0x27a633fcdd4ac0d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.149373:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f1c21f0600/0x27a633fcdd4ac0d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.149492:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1c21f1200/0x27a633fcdd4ac14 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.149502:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f1c21f1200/0x27a633fcdd4ac14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.149512:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f1c21f1200/0x27a633fcdd4ac14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940441.149663:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788940441.149672:0:5861:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788940441.149718:0:5861:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f1c21f1200/0x27a633fcdd4ac14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940441.149738:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1c21f0a00/0x27a633fcdd4ac06 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940441.149760:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f1c21f0a00/0x27a633fcdd4ac06 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940441.149768:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f1c21f0a00/0x27a633fcdd4ac06 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940441.149776:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1c21f0a00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:0.0:1788940441.149781:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f1c21f0a00/0x27a633fcdd4ac06 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940441.149791:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f1c21f0a00/0x27a633fcdd4ac06 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940441.149809:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f188f81c00) 00010000:00010000:0.0:1788940441.149813:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940441.149820:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f1c21f0a00/0x27a633fcdd4ac06 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940441.149827:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f1c21f0a00/0x27a633fcdd4ac06 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940441.149852:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1c21f0600/0x27a633fcdd4ac0d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940441.149858:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f1c21f0600/0x27a633fcdd4ac0d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940441.149864:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f1c21f0600/0x27a633fcdd4ac0d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940441.149869:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1c21f0600 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:0.0:1788940441.149878:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f1c21f0600/0x27a633fcdd4ac0d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940441.149886:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f1c21f0600/0x27a633fcdd4ac0d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940441.149915:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff89f18a6cee00) 00010000:00010000:0.0:1788940441.149918:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940441.149922:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f1c21f0600/0x27a633fcdd4ac0d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940441.149929:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f1c21f0600/0x27a633fcdd4ac0d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940441.149978:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f1c21f0e00/0x27a633fcdd4abff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5734 expref: 10 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940441.149993:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1c21f1200/0x27a633fcdd4ac14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5734 expref: 9 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940441.150001:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff89f18a6ceb00) 00010000:00010000:0.0:1788940441.150003:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788940441.150005:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f1c21f1200, rc 0) 00000100:00100000:0.0:1788940441.150102:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b500d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+9:9694:x1875839718279424:12345-192.168.202.14@tcp:101:chown.0 Request processed in 925us (4700us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940441.150112:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 19 00000100:00100000:2.0:1788940441.156717:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940441.156817:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718279680 00000100:00100000:3.0:1788940441.156834:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718279680 00000100:00100000:3.0:1788940441.156929:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 20 00000100:00100000:3.0:1788940441.156941:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfae8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+9:9694:x1875839718279680:12345-192.168.202.14@tcp:36:chown.0 00010000:00010000:3.0:1788940441.157022:0:5860:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940441.157057:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f1c21f1200/0x27a633fcdd4ac14 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5734 expref: 9 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.157084:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff89f18a6ceb00) 00010000:00010000:3.0:1788940441.157098:0:5860:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788940441.157132:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829da800/0x27a633fcdd4ac1b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.157148:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829da800/0x27a633fcdd4ac1b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.157159:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829da800/0x27a633fcdd4ac1b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788940441.217955:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:1.0:1788940441.218099:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:2.0:1788940441.218248:0:5860:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005521754f reply state 000000006a49b4d7 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829da800/0x27a633fcdd4ac1b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940441.218266:0:5860:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788940441.218286:0:5860:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:2.0:1788940441.218727:0:5860:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1788940441.218755:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfae8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+7:9694:x1875839718279680:12345-192.168.202.14@tcp:36:chown.0 Request processed in 61811us (62048us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788940441.218780:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 20 00010000:00010000:1.0:1788940441.218787:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829da800/0x27a633fcdd4ac1b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.218799:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829da800/0x27a633fcdd4ac1b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.218831:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829da800/0x27a633fcdd4ac1b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.218837:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1829da800 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940441.218843:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829da800/0x27a633fcdd4ac1b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.218852:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829da800/0x27a633fcdd4ac1b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.218871:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff89f18a6ce100) 00010000:00010000:1.0:1788940441.218874:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788940441.218881:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829da800/0x27a633fcdd4ac1b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.218887:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829da800/0x27a633fcdd4ac1b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.261096:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940441.261450:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940441.261551:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718279808 00000100:00100000:1.0:1788940441.261565:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718279808 00000100:00100000:1.0:1788940441.261625:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 21 00000100:00100000:1.0:1788940441.261637:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfae8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:9695:x1875839718279808:12345-192.168.202.14@tcp:101:touch.500 00010000:00010000:1.0:1788940441.261663:0:7857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940441.261683:0:7857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4ac22 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f573b expref: -99 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788940441.270192:0:7857:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 8450us 00010000:00010000:3.0:1788940441.285052:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829db400/0x27a633fcdd4ac29 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.285077:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829db400/0x27a633fcdd4ac29 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.285091:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829db400/0x27a633fcdd4ac29 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.285109:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829db200/0x27a633fcdd4ac30 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.285116:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829db200/0x27a633fcdd4ac30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.285122:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829db200/0x27a633fcdd4ac30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.285493:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829da800/0x27a633fcdd4ac37 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.285503:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829da800/0x27a633fcdd4ac37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.285511:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829da800/0x27a633fcdd4ac37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940441.285565:0:7857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788940441.285569:0:7857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788940441.285610:0:7857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829da800/0x27a633fcdd4ac37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.285621:0:7857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829db400/0x27a633fcdd4ac29 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.285635:0:7857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829db400/0x27a633fcdd4ac29 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.285643:0:7857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829db400/0x27a633fcdd4ac29 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.285649:0:7857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1829db400 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940441.285654:0:7857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829db400/0x27a633fcdd4ac29 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.285664:0:7857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829db400/0x27a633fcdd4ac29 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.285678:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f188f81c00) 00010000:00010000:3.0:1788940441.285682:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940441.285688:0:7857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829db400/0x27a633fcdd4ac29 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.285695:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829db400/0x27a633fcdd4ac29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.285708:0:7857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829db200/0x27a633fcdd4ac30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.285714:0:7857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829db200/0x27a633fcdd4ac30 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.285719:0:7857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829db200/0x27a633fcdd4ac30 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.285723:0:7857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1829db200 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940441.285731:0:7857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829db200/0x27a633fcdd4ac30 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.285737:0:7857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829db200/0x27a633fcdd4ac30 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.285744:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff89f18a6ceb00) 00010000:00010000:3.0:1788940441.285747:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940441.285750:0:7857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829db200/0x27a633fcdd4ac30 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.285756:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829db200/0x27a633fcdd4ac30 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.285799:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4ac22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f573b expref: 8 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.285815:0:7857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829da800/0x27a633fcdd4ac37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f573b expref: 7 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.285824:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff89f18a6ce700) 00010000:00010000:3.0:1788940441.285827:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788940441.285829:0:7857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f1829da800, rc 0) 00000100:00100000:3.0:1788940441.285923:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfae8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+7:9695:x1875839718279808:12345-192.168.202.14@tcp:101:touch.500 Request processed in 24286us (24476us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940441.285935:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 21 00000100:00100000:1.0:1788940441.291187:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940441.291262:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718280064 00000100:00100000:0.0:1788940441.291275:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718280064 00000100:00100000:0.0:1788940441.291344:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 22 00000100:00100000:0.0:1788940441.291357:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b8bf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+7:9695:x1875839718280064:12345-192.168.202.14@tcp:101:touch.500 00010000:00010000:0.0:1788940441.291396:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940441.291418:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4ac3e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5742 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940441.292354:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3c00/0x27a633fcdd4ac45 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940441.292370:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3c00/0x27a633fcdd4ac45 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940441.292381:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3c00/0x27a633fcdd4ac45 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940441.292395:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3200/0x27a633fcdd4ac4c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940441.292402:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3200/0x27a633fcdd4ac4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940441.292407:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3200/0x27a633fcdd4ac4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788940441.297845:0:5862:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:0.0:1788940441.299149:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4ac53 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940441.299173:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4ac53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940441.299187:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4ac53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940441.299252:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3c00/0x27a633fcdd4ac45 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940441.299260:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3c00/0x27a633fcdd4ac45 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940441.299268:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3c00/0x27a633fcdd4ac45 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940441.299275:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad3c00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:0.0:1788940441.299279:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3c00/0x27a633fcdd4ac45 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940441.299288:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3c00/0x27a633fcdd4ac45 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940441.299302:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff89f18a6ce700) 00010000:00010000:0.0:1788940441.299305:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940441.299313:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3c00/0x27a633fcdd4ac45 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940441.299319:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3c00/0x27a633fcdd4ac45 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788940441.299338:0:5862:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009a7317a6 reply state 00000000def47437 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3200/0x27a633fcdd4ac4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940441.299348:0:5862:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788940441.299394:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4ac3e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5742 expref: 10 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940441.299423:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4ac53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5742 expref: 9 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940441.299645:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff89f1983af100) 00010000:00010000:0.0:1788940441.299648:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788940441.299650:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f082ad2e00, rc 0) 00000100:00100000:0.0:1788940441.299771:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b8bf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+10:9695:x1875839718280064:12345-192.168.202.14@tcp:101:touch.500 Request processed in 8414us (8591us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788940441.299781:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 22 00000100:00100000:0.0:1788940441.307541:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940441.307651:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718280320 00000100:00100000:2.0:1788940441.307663:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718280320 00000100:00100000:2.0:1788940441.307735:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 23 00000100:00100000:2.0:1788940441.307747:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf97e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+10:9695:x1875839718280320:12345-192.168.202.14@tcp:36:touch.500 00010000:00010000:2.0:1788940441.307809:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940441.307840:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4ac53 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5742 expref: 10 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940441.307872:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff89f1983af100) 00010000:00010000:2.0:1788940441.307886:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788940441.307940:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4ac61 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940441.307954:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4ac61 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940441.307963:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4ac61 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788940441.308105:0:5861:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000096aff35c reply state 00000000abbd183a transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4ac61 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940441.308114:0:5861:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788940441.308214:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf97e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+11:9695:x1875839718280320:12345-192.168.202.14@tcp:36:touch.500 Request processed in 468us (695us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788940441.308239:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 23 00010000:00010000:3.0:1788940441.309819:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3200/0x27a633fcdd4ac4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.309839:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3200/0x27a633fcdd4ac4c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.310132:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3200/0x27a633fcdd4ac4c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.310140:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad3200 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940441.310147:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3200/0x27a633fcdd4ac4c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.310158:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3200/0x27a633fcdd4ac4c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.310178:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x596de974 (ffff89f1983af600) 00010000:00010000:3.0:1788940441.310182:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940441.310189:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3200/0x27a633fcdd4ac4c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.310196:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3200/0x27a633fcdd4ac4c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.314241:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4ac61 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.314276:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4ac61 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940441.314286:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00010000:00010000:1.0:1788940441.314286:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4ac61 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.314296:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188dab600 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940441.314302:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4ac61 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.314310:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4ac61 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.314328:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff89f186946000) 00010000:00010000:1.0:1788940441.314331:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940441.314336:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4ac61 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.314342:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4ac61 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940441.314560:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718280448 00000100:00100000:2.0:1788940441.314574:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718280448 00000100:00100000:2.0:1788940441.314639:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 24 00000100:00100000:2.0:1788940441.314650:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf69e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+9:9695:x1875839718280448:12345-192.168.202.14@tcp:101:touch.500 00010000:00010000:2.0:1788940441.314677:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940441.314696:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4ac68 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5749 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940441.314759:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4ac68 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5749 expref: 10 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940441.314773:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4ac68 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5749 expref: 10 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940441.314791:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff89f186946600) 00010000:00010000:2.0:1788940441.314794:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788940441.314797:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f188daac00, rc 0) 00000100:00100000:2.0:1788940441.314881:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf69e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+10:9695:x1875839718280448:12345-192.168.202.14@tcp:101:touch.500 Request processed in 232us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940441.314888:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 24 00000100:00100000:2.0:1788940441.318681:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940441.324224:0:7074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718280576 00000100:00100000:1.0:1788940441.324252:0:7074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718280576 00000100:00100000:0.0:1788940441.324759:0:7074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 16 00000100:00100000:0.0:1788940441.324770:0:7074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfaeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2349:x1875839718280576:12345-192.168.202.14@tcp:8:touch.500 00010000:00080000:0.0:1788940441.324805:0:7074:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 9c51ff78-d02d-4e61-8a10-a2f8830f1679@192.168.202.14@tcp t0 exp 0000000000000000 cur 384 last 0 00000020:00000080:0.0:1788940441.324840:0:7074:0:(genops.c:1393:class_connect()) connect: client 9c51ff78-d02d-4e61-8a10-a2f8830f1679, cookie 0x27a633fcdd4ac6f 00002000:00100000:0.0:1788940441.324852:0:7074:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 9c51ff78-d02d-4e61-8a10-a2f8830f1679/ffff89f1901ae800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788940441.324874:0:7074:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788940441.325144:0:7074:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788940441.325181:0:7074:0:(import.c:65:import_set_state_nolock()) ffff89f1b5c5f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788940441.325266:0:7074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfaeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2349:x1875839718280576:12345-192.168.202.14@tcp:8:touch.500 Request processed in 495us (6612us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940441.325274:0:7074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 16 00000100:00100000:3.0:1788940441.330569:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940441.330736:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718280704 00000100:00100000:2.0:1788940441.330749:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718280704 00000100:00100000:2.0:1788940441.330822:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 17 00000100:00100000:2.0:1788940441.330832:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf69c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:0:x1875839718280704:12345-192.168.202.14@tcp:2:touch.500 00000100:00080000:3.0:1788940441.331641:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:3.0:1788940441.441879:0:6732:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9c51ff78-d02d-4e61-8a10-a2f8830f1679 00000001:00080000:3.0:1788940441.443322:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:2.0:1788940441.443696:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf69c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+5:0:x1875839718280704:12345-192.168.202.14@tcp:2:touch.500 Request processed in 112857us (113171us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788940441.443708:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 17 00000100:00100000:3.0:1788940441.445778:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940441.446042:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718280960 00000100:00100000:2.0:1788940441.446055:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718280960 00000100:00100000:2.0:1788940441.446171:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 2 00000100:00100000:2.0:1788940441.446184:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf69d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+10:9695:x1875839718280960:12345-192.168.202.14@tcp:35:touch.500 00000100:00100000:2.0:1788940441.446756:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf69d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+11:9695:x1875839718280960:12345-192.168.202.14@tcp:35:touch.500 Request processed in 571us (984us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788940441.446766:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 2 00000100:00100000:1.0:1788940441.461722:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940441.461829:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718281088 00000100:00100000:2.0:1788940441.461843:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718281088 00000100:00100000:2.0:1788940441.461934:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 25 00000100:00100000:2.0:1788940441.461947:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b8bf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+11:9696:x1875839718281088:12345-192.168.202.14@tcp:101:rm.0 00010000:00010000:2.0:1788940441.461975:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940441.462008:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4ac76 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5750 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940441.462080:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4ac7d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940441.462097:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4ac7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940441.462108:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4ac7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940441.462143:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788940441.462162:0:5861:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788940441.462204:0:5861:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4ac7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940441.462232:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4ac76 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5750 expref: 13 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940441.462251:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4ac7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5750 expref: 12 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940441.462260:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff89f18a6ce700) 00010000:00010000:2.0:1788940441.462262:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788940441.462267:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f188daba00, rc 0) 00000100:00100000:2.0:1788940441.462331:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b8bf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+12:9696:x1875839718281088:12345-192.168.202.14@tcp:101:rm.0 Request processed in 386us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940441.462339:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 25 00000100:00100000:2.0:1788940441.465358:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940441.465464:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718281344 00000100:00100000:0.0:1788940441.465476:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718281344 00000100:00100000:0.0:1788940441.465575:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 26 00000100:00100000:0.0:1788940441.465598:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfaead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+12:9696:x1875839718281344:12345-192.168.202.14@tcp:101:rm.0 00010000:00010000:0.0:1788940441.465625:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940441.465646:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4ac84 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5757 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940441.465747:0:5860:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788940441.466199:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4ac84 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5757 expref: 14 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940441.466215:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f188f81c00) 00010000:00010000:0.0:1788940441.466219:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788940441.466224:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4ac84 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5757 expref: 14 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940441.466240:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f082ad2600, rc 0) 00000100:00100000:0.0:1788940441.466330:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfaead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+13:9696:x1875839718281344:12345-192.168.202.14@tcp:101:rm.0 Request processed in 733us (992us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1788940441.466338:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 26 00000100:00100000:3.0:1788940441.469598:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940441.469904:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718281472 00000100:00100000:1.0:1788940441.469917:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718281472 00000100:00100000:1.0:1788940441.469979:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 3 00000100:00100000:1.0:1788940441.469991:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf69d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+13:9696:x1875839718281472:12345-192.168.202.14@tcp:37:rm.0 00000100:00100000:0.0:1788940441.480211:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf69d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+13:9696:x1875839718281472:12345-192.168.202.14@tcp:37:rm.0 Request processed in 10207us (10609us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940441.480259:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 3 00000100:00100000:2.0:1788940441.483583:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940441.483748:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718281728 00000100:00100000:1.0:1788940441.483760:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718281728 00000100:00100000:1.0:1788940441.483826:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 4 00000100:00100000:1.0:1788940441.483837:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b0612450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+13:9696:x1875839718281728:12345-192.168.202.14@tcp:35:rm.0 00000100:00100000:1.0:1788940441.484127:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b0612450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+14:9696:x1875839718281728:12345-192.168.202.14@tcp:35:rm.0 Request processed in 290us (554us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788940441.484135:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 4 00000100:00100000:3.0:1788940441.487770:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940441.487888:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718281984 00000100:00100000:2.0:1788940441.487909:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718281984 00000100:00100000:2.0:1788940441.487977:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 27 00000100:00100000:2.0:1788940441.487989:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf69c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+14:9696:x1875839718281984:12345-192.168.202.14@tcp:101:rm.0 00010000:00010000:2.0:1788940441.488344:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940441.488378:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa800/0x27a633fcdd4ac92 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f575e expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940441.488719:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa200/0x27a633fcdd4ac99 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940441.488759:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa200/0x27a633fcdd4ac99 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940441.488774:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa200/0x27a633fcdd4ac99 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940441.488789:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788940441.489266:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa800/0x27a633fcdd4ac92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f575e expref: 17 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940441.489292:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa200/0x27a633fcdd4ac99 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f575e expref: 16 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940441.489300:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff89f18a6ce700) 00010000:00010000:2.0:1788940441.489304:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788940441.489307:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f188daa200, rc 0) 00000100:00100000:2.0:1788940441.489666:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf69c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+16:9696:x1875839718281984:12345-192.168.202.14@tcp:101:rm.0 Request processed in 1676us (1903us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788940441.489676:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 27 00000100:00100000:2.0:1788940441.500630:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940441.500730:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718282112 00000100:00100000:1.0:1788940441.500742:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718282112 00000100:00100000:1.0:1788940441.500810:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 28 00000100:00100000:1.0:1788940441.500823:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+16:9696:x1875839718282112:12345-192.168.202.14@tcp:41:rm.0 00000004:00000024:1.0:1788940441.500940:0:5862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:1.0:1788940441.501028:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+16:9696:x1875839718282112:12345-192.168.202.14@tcp:41:rm.0 Request processed in 208us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940441.501036:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 28 00000100:00100000:0.0:1788940441.503477:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940441.503672:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718282240 00000100:00100000:3.0:1788940441.503683:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718282240 00000100:00100000:3.0:1788940441.503749:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 29 00000100:00100000:3.0:1788940441.503775:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf97ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+16:9696:x1875839718282240:12345-192.168.202.14@tcp:101:rm.0 00010000:00010000:3.0:1788940441.503801:0:7857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940441.503823:0:7857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031000/0x27a633fcdd4aca7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5765 expref: -99 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.504132:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031a00/0x27a633fcdd4acae lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.504148:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031a00/0x27a633fcdd4acae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.504160:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031a00/0x27a633fcdd4acae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.504175:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031e00/0x27a633fcdd4acb5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.504182:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031e00/0x27a633fcdd4acb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.504188:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031e00/0x27a633fcdd4acb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.504294:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4acbc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.504302:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4acbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.504309:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4acbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940441.504354:0:7857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788940441.504359:0:7857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788940441.504383:0:7857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4acbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.504397:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4acbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.504405:0:7857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031a00/0x27a633fcdd4acae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.504411:0:7857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031a00/0x27a633fcdd4acae lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.504418:0:7857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031a00/0x27a633fcdd4acae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.504502:0:7857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f180031a00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940441.504508:0:7857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031a00/0x27a633fcdd4acae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.504653:0:7857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031a00/0x27a633fcdd4acae lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.504669:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff89f18a6ce700) 00010000:00010000:3.0:1788940441.504672:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940441.504677:0:7857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031a00/0x27a633fcdd4acae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.504683:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031a00/0x27a633fcdd4acae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.504707:0:7857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031e00/0x27a633fcdd4acb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.504713:0:7857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031e00/0x27a633fcdd4acb5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.504719:0:7857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031e00/0x27a633fcdd4acb5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.504724:0:7857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f180031e00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940441.504726:0:7857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031e00/0x27a633fcdd4acb5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.504733:0:7857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031e00/0x27a633fcdd4acb5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.504740:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x596de974 (ffff89f18a6ce200) 00010000:00010000:3.0:1788940441.504743:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940441.504746:0:7857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031e00/0x27a633fcdd4acb5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.504752:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031e00/0x27a633fcdd4acb5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.504786:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031000/0x27a633fcdd4aca7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5765 expref: 18 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.504799:0:7857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4acbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5765 expref: 17 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.504818:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff89f186946600) 00010000:00010000:3.0:1788940441.504820:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788940441.504823:0:7857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f180030a00, rc 0) 00000100:00100000:3.0:1788940441.505299:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf97ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+17:9696:x1875839718282240:12345-192.168.202.14@tcp:101:rm.0 Request processed in 1522us (1828us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940441.505308:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 29 00000100:00100000:2.0:1788940441.518694:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940441.518808:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718282496 00000100:00100000:1.0:1788940441.518821:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718282496 00000100:00100000:1.0:1788940441.518892:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 30 00000100:00100000:1.0:1788940441.518913:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+17:9696:x1875839718282496:12345-192.168.202.14@tcp:36:rm.0 00010000:00010000:1.0:1788940441.518974:0:5862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788940441.519013:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4acbc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5765 expref: 17 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.519039:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4ac68 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5749 expref: 16 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.519051:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff89f186946600) 00010000:00010000:1.0:1788940441.519079:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4ac7d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5750 expref: 15 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.519108:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff89f18a6ce700) 00010000:00010000:1.0:1788940441.519112:0:5862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788940441.519136:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ca00/0x27a633fcdd4acc3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.519150:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ca00/0x27a633fcdd4acc3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.519160:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ca00/0x27a633fcdd4acc3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.519176:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258de00/0x27a633fcdd4acca lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.519182:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258de00/0x27a633fcdd4acca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.519190:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258de00/0x27a633fcdd4acca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.519306:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4acd1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.519315:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4acd1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.519322:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4acd1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788940441.526695:0:5862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1788940441.526719:0:5862:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 384425200066ns, next at 385425195511ns, rc = 0 00010000:00010000:1.0:1788940441.526838:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4acd8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.526856:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4acd8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.526867:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4acd8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.526876:0:5862:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4acd8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.526882:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4acd8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.526887:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4acd8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.526921:0:5862:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788940441.526945:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4acd1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.526952:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4acd1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.526958:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4acd1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.526963:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258c000 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940441.526967:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4acd1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.526975:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4acd1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940441.527249:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940441.527257:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4acd8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.529435:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff89f188f81900) 00010000:00010000:1.0:1788940441.529451:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788940441.529466:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4acd1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.529477:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4acd1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.529549:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ca00/0x27a633fcdd4acc3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.529556:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ca00/0x27a633fcdd4acc3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.529564:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ca00/0x27a633fcdd4acc3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.529570:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258ca00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940441.529574:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ca00/0x27a633fcdd4acc3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.529582:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ca00/0x27a633fcdd4acc3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.529598:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff89f18a6ce700) 00010000:00010000:1.0:1788940441.529601:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940441.529604:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ca00/0x27a633fcdd4acc3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.529609:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ca00/0x27a633fcdd4acc3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788940441.529646:0:5862:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000ba367f2 reply state 0000000086984fce transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258de00/0x27a633fcdd4acca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940441.529656:0:5862:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788940441.529788:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+16:9696:x1875839718282496:12345-192.168.202.14@tcp:36:rm.0 Request processed in 10871us (11102us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788940441.529798:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 30 00010000:00010000:2.0:1788940441.533747:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258c400 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:2.0:1788940441.533762:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4acd8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940441.533805:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4acd8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940441.533826:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff89f188f81900) 00010000:00010000:2.0:1788940441.533829:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788940441.533835:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4acd8 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940441.533841:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4acd8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940441.534348:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940441.534352:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940441.534355:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940441.534636:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258de00/0x27a633fcdd4acca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.534648:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258de00/0x27a633fcdd4acca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.534655:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258de00/0x27a633fcdd4acca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.534660:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258de00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940441.534664:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258de00/0x27a633fcdd4acca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.534670:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258de00/0x27a633fcdd4acca lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.534682:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x596de974 (ffff89f188f81100) 00010000:00010000:3.0:1788940441.534685:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940441.534688:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258de00/0x27a633fcdd4acca lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940441.534694:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258de00/0x27a633fcdd4acca lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940441.543660:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940441.543819:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718282752 00000100:00100000:1.0:1788940441.543831:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718282752 00000100:00100000:1.0:1788940441.543916:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 5 00000100:00100000:1.0:1788940441.543927:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+15:9696:x1875839718282752:12345-192.168.202.14@tcp:35:rm.0 00000100:00100000:1.0:1788940441.544471:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+16:9696:x1875839718282752:12345-192.168.202.14@tcp:35:rm.0 Request processed in 543us (820us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788940441.544480:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 5 00000100:00100000:1.0:1788940441.554144:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940441.556320:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718283008 00000100:00100000:2.0:1788940441.556338:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718283008 00000100:00100000:2.0:1788940441.556419:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 31 00000100:00100000:2.0:1788940441.556434:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b8bf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+16:9696:x1875839718283008:12345-192.168.202.14@tcp:36:rm.0 00010000:00010000:2.0:1788940441.556499:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788940441.556547:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa200/0x27a633fcdd4ac99 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f575e expref: 16 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940441.556577:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829da800/0x27a633fcdd4ac37 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f573b expref: 15 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940441.556590:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff89f18a6ce700) 00010000:00010000:2.0:1788940441.556607:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4abf8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f572d expref: 14 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940441.556633:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f188f81c00) 00010000:00010000:2.0:1788940441.556641:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788940441.556665:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabc00/0x27a633fcdd4acdf lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940441.556677:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabc00/0x27a633fcdd4acdf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940441.556687:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabc00/0x27a633fcdd4acdf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940441.556700:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4ace6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940441.556707:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4ace6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940441.556713:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4ace6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940441.557126:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab200/0x27a633fcdd4aced lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940441.557137:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab200/0x27a633fcdd4aced lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940441.557144:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab200/0x27a633fcdd4aced lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940441.557816:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788940441.557837:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab200/0x27a633fcdd4aced lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940441.557851:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab200/0x27a633fcdd4aced lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940441.562568:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab200/0x27a633fcdd4aced lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940441.562591:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188dab200 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940441.562598:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab200/0x27a633fcdd4aced lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940441.562609:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab200/0x27a633fcdd4aced lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940441.562627:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff89f186946900) 00010000:00010000:2.0:1788940441.562630:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788940441.562636:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab200/0x27a633fcdd4aced lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940441.562642:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab200/0x27a633fcdd4aced lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940441.562681:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabc00/0x27a633fcdd4acdf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940441.562688:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabc00/0x27a633fcdd4acdf lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940441.562695:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabc00/0x27a633fcdd4acdf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940441.562700:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188dabc00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940441.562720:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabc00/0x27a633fcdd4acdf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940441.562727:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabc00/0x27a633fcdd4acdf lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940441.562735:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f186946300) 00010000:00010000:2.0:1788940441.562737:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940441.562741:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabc00/0x27a633fcdd4acdf lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940441.562747:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabc00/0x27a633fcdd4acdf lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788940441.562761:0:5861:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007685dc54 reply state 000000006bc741dc transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4ace6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940441.562771:0:5861:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788940441.562883:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b8bf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+15:9696:x1875839718283008:12345-192.168.202.14@tcp:36:rm.0 Request processed in 6448us (8744us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788940441.562903:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 31 00010000:00010000:1.0:1788940441.567256:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4ace6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.567273:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4ace6 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.567282:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4ace6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.567288:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188daa600 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940441.567293:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4ace6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.567320:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4ace6 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.567336:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff89f186946a00) 00010000:00010000:1.0:1788940441.567339:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940441.567343:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4ace6 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940441.567349:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4ace6 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940442.103236:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738241152:0@lo:400:kworker.0 00000100:00100000:2.0:1788940442.103317:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940442.103393:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788940442.103399:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875839738241024:0@lo:400:kworker.0 00000100:00100000:2.0:1788940442.103428:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940442.103677:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3307:1875839738240768:0@lo:400:kworker.0 00000100:00100000:1.0:1788940442.103718:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940442.103749:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875839738241280:0@lo:400:kworker.0 00000100:00100000:1.0:1788940442.103788:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940442.103808:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788940442.103814:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875839738240896:0@lo:400:kworker.0 00000100:00100000:1.0:1788940442.103837:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940442.103852:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738241408:0@lo:400:kworker.0 00000100:00100000:1.0:1788940442.103918:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940442.103955:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738241152 00000100:00100000:1.0:1788940442.103965:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738241152 00000100:00100000:1.0:1788940442.104013:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738241408 00000100:00100000:1.0:1788940442.104016:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738241408 00000100:00100000:1.0:1788940442.104048:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788940442.104056:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4cd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738241152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940442.104115:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4cd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738241152:12345-0@lo:400:kworker.0 Request processed in 60us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940442.104362:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788940442.104396:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788940442.104404:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae7c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738241408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940442.104442:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae7c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738241408:12345-0@lo:400:kworker.0 Request processed in 40us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940442.104448:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:1.0:1788940442.104475:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788940442.104514:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1b5c6d880 x1875839738241152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940458 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940442.104569:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738241152:0@lo:400:kworker.0 00010000:00080000:1.0:1788940442.104603:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1b5c6e680 x1875839738241408/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940458 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940442.104611:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738241408:0@lo:400:kworker.0 00000100:00100000:1.0:1788940442.104627:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738241024 00000100:00100000:1.0:1788940442.104631:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738241024 00000100:00100000:1.0:1788940442.104660:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738241280 00000100:00100000:1.0:1788940442.104663:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738241280 00000100:00100000:1.0:1788940442.104675:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738240896 00000100:00100000:1.0:1788940442.104677:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738240896 00000100:00100000:1.0:1788940442.104688:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788940442.104693:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4cd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875839738241024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940442.104731:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4cd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875839738241024:12345-0@lo:400:kworker.0 Request processed in 38us (1303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940442.104738:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788940442.104749:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788940442.105120:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788940442.105130:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae81f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875839738240896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940442.105187:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae81f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875839738240896:12345-0@lo:400:kworker.0 Request processed in 60us (1349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940442.105204:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788940442.105236:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875839738240896:0@lo:400:kworker.0 00000100:00080000:0.0:1788940442.105276:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788940442.105300:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875839738241024:0@lo:400:kworker.0 00000100:00100000:1.0:1788940442.105550:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b8bf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875839738241280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940442.105601:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b8bf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875839738241280:12345-0@lo:400:kworker.0 Request processed in 837us (1812us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940442.105607:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788940442.105904:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738240768 00000100:00100000:2.0:1788940442.105911:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738240768 00000100:00100000:2.0:1788940442.105958:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1788940442.105966:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f188d36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3307:x1875839738240768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940442.106026:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f188d36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3307:x1875839738240768:12345-0@lo:400:kworker.0 Request processed in 60us (2307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940442.106031:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788940442.106413:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3307:1875839738240768:0@lo:400:kworker.0 00000100:00100000:0.0:1788940442.106428:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875839738241280:0@lo:400:kworker.0 00010000:00010000:3.0:1788940442.288504:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940442.604930:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788940442.604971:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf97e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738241536:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788940442.605087:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940442.605186:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738241536 00000100:00100000:0.0:1788940442.605196:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738241536 00000100:00100000:0.0:1788940442.605263:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788940442.605273:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf97c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738241536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788940442.605321:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788940442.605376:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf97c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738241536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940442.605384:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:0.0:1788940442.605440:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1bf97e680 x1875839738241536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940458 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940442.605463:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf97e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738241536:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788940443.308773:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940444.334127:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940445.356984:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940445.692654:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940445.692704:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940445.692724:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718283136 00000100:00100000:3.0:1788940445.692737:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718283136 00000100:00100000:1.0:1788940445.692746:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940445.692782:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940445.692807:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 259 00000100:00100000:1.0:1788940445.692812:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718283264 00000100:00100000:1.0:1788940445.692817:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718283264 00000100:00100000:3.0:1788940445.692833:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1980ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:2351:x1875839718283136:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788940445.692879:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718283520 00000100:00100000:1.0:1788940445.692883:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718283520 00000100:00100000:1.0:1788940445.692908:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 116 00000100:00100000:1.0:1788940445.692916:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae7c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+14:2351:x1875839718283264:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788940445.692925:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1980ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:2351:x1875839718283136:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 95us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940445.692935:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 259 00000100:00100000:1.0:1788940445.692957:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae7c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+14:2351:x1875839718283264:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 41us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940445.692965:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 116 00000100:00100000:1.0:1788940445.692983:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 117 00000100:00100000:1.0:1788940445.692992:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae7c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffa310cd-169f-42e3-8999-506116bada08+5:2351:x1875839718283520:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788940445.693023:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae7c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffa310cd-169f-42e3-8999-506116bada08+5:2351:x1875839718283520:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 33us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940445.693029:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 117 00000100:00080000:0.0:1788940445.693723:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940445.693993:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718283392 00000100:00100000:2.0:1788940445.694000:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718283392 00000100:00100000:2.0:1788940445.694064:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 63 00000100:00100000:2.0:1788940445.694074:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae7ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+5:2351:x1875839718283392:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788940445.694143:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae7ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+5:2351:x1875839718283392:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 70us (1439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940445.694150:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 63 00000100:00080000:0.0:1788940445.694744:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788940446.141229:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae7c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875839738241792:0@lo:400:kworker.0 00000100:00100000:1.0:1788940446.141442:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940446.141548:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae7c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738242304:0@lo:400:kworker.0 00000100:00100000:1.0:1788940446.141587:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940446.141627:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788940446.141634:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae7cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875839738241920:0@lo:400:kworker.0 00000100:00100000:1.0:1788940446.141654:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940446.141678:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae7c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3306:1875839738241664:0@lo:400:kworker.0 00000100:00100000:1.0:1788940446.141707:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940446.141729:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae7c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875839738242176:0@lo:400:kworker.0 00000100:00100000:1.0:1788940446.141748:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940446.141764:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788940446.141769:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae7c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738242048:0@lo:400:kworker.0 00000100:00100000:1.0:1788940446.141790:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940446.141818:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738242304 00000100:00100000:1.0:1788940446.141826:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738242304 00000100:00100000:1.0:1788940446.141895:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738242048 00000100:00100000:1.0:1788940446.141899:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738242048 00000100:00100000:1.0:1788940446.141924:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788940446.141934:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae7c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738242304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940446.142001:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae7c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738242304:12345-0@lo:400:kworker.0 Request processed in 69us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940446.142008:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788940446.142024:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788940446.142030:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae7cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738242048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940446.142057:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae7cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738242048:12345-0@lo:400:kworker.0 Request processed in 27us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940446.142062:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788940446.142381:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738241792 00000100:00100000:1.0:1788940446.142393:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738241792 00000100:00100000:1.0:1788940446.142417:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738241920 00000100:00100000:1.0:1788940446.142420:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738241920 00000100:00100000:1.0:1788940446.142431:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738242176 00000100:00100000:1.0:1788940446.142432:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738242176 00000100:00100000:1.0:1788940446.142446:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788940446.142452:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae7c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875839738241792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940446.142485:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae7c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875839738241792:12345-0@lo:400:kworker.0 Request processed in 32us (1181us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940446.142491:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788940446.142503:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788940446.142509:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae7cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875839738241920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940446.142559:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae7cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875839738241920:12345-0@lo:400:kworker.0 Request processed in 51us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940446.142565:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788940446.142577:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788940446.142583:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae7cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875839738242176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940446.142606:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae7cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875839738242176:12345-0@lo:400:kworker.0 Request processed in 24us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940446.142861:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738241664 00000100:00100000:2.0:1788940446.142867:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738241664 00000100:00100000:2.0:1788940446.142897:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1788940446.142904:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1980dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3306:x1875839738241664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940446.142942:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1980dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3306:x1875839738241664:12345-0@lo:400:kworker.0 Request processed in 39us (1234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940446.142947:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00080000:2.0:1788940446.145500:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788940446.145514:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788940446.145532:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788940446.147713:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788940446.148939:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae7cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875839738241920:0@lo:400:kworker.0 00000100:00100000:1.0:1788940446.148964:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae7c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875839738241792:0@lo:400:kworker.0 00010000:00080000:1.0:1788940446.148980:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1ae7c8000 x1875839738242304/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940446.148990:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae7c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738242304:0@lo:400:kworker.0 00010000:00080000:1.0:1788940446.149053:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1ae7c9f80 x1875839738242048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940446.149063:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae7c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738242048:0@lo:400:kworker.0 00000100:00100000:1.0:1788940446.149074:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae7c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3306:1875839738241664:0@lo:400:kworker.0 00000100:00100000:1.0:1788940446.149084:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae7c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875839738242176:0@lo:400:kworker.0 00000004:00080000:1.0:1788940446.190655:0:7037:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 389089131680ns, next at 390089128029ns, rc = 0 00000100:00100000:1.0:1788940446.190686:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788940446.190715:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae7c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738242432:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788940446.190817:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940446.194728:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738242432 00000100:00100000:0.0:1788940446.194757:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738242432 00000100:00100000:0.0:1788940446.194822:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788940446.194832:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae7c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738242432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788940446.194889:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788940446.194977:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae7c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738242432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 146us (4159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940446.194984:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:0.0:1788940446.200568:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1ae7c9880 x1875839738242432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940462 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940446.200602:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae7c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738242432:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1788940446.278671:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967303 is committed 00000004:00080000:1.0:1788940446.278692:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:1.0:1788940446.278755:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000004:00080000:1.0:1788940446.278760:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:0.0:1788940446.283381:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788940446.283404:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4cd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738242560:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788940446.283472:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940446.283742:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738242560 00000100:00100000:2.0:1788940446.283752:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738242560 00000100:00100000:2.0:1788940446.283812:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788940446.283822:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf97e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738242560:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788940446.283861:0:6707:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:2.0:1788940446.283897:0:6707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6aa1109a, atime: 0x6aa1109a, ctime: 0x6aa1109a, blocks: 0x1 00010000:00010000:2.0:1788940446.283918:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000644c5e36/0x27a633fcdd4acf4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940446.283932:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=389s v=(0 0) 00010000:00010000:2.0:1788940446.283937:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940446.283944:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000644c5e36/0x27a633fcdd4acf4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940446.283960:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000644c5e36/0x27a633fcdd4acf4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940446.283971:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000644c5e36/0x27a633fcdd4acf4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940446.283979:0:6707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000644c5e36/0x27a633fcdd4acf4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940446.283997:0:6707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000001:00080000:1.0:1788940446.284599:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:2.0:1788940446.286114:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf97e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1875839738242560:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2285us (2634us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788940446.286127:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1788940446.286165:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940446.286174:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000644c5e36/0x27a633fcdd4acf4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940446.286185:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188daaa00 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:2.0:1788940446.286190:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000644c5e36/0x27a633fcdd4acf4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940446.286211:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000644c5e36/0x27a633fcdd4acf4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940446.286232:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000644c5e36/0x27a633fcdd4acf4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940446.286239:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000644c5e36/0x27a633fcdd4acf4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940446.286259:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940446.286261:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940446.286262:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788940446.286436:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89f1b4cd1880/2, rc 0, transno 4294967300 00000100:00100000:1.0:1788940446.286443:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4cd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738242560:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788940446.382926:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788940446.821631:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:02000400:1.0:1788940446.951328:0:11643:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:2.0:1788940447.404833:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940447.741467:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788940447.741503:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae7c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738242688:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788940447.741639:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940447.742087:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738242688 00000100:00100000:1.0:1788940447.742100:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738242688 00000100:00100000:1.0:1788940447.742165:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788940447.742176:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf69f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738242688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788940447.742229:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788940447.742282:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf69f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738242688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940447.742314:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1788940447.742543:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1ae7c9f80 x1875839738242688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940463 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940447.742566:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae7c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738242688:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788940448.428723:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788940448.779164:0:11691:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe4a89b7e0 20000000:00000080:3.0:1788940448.779185:0:11691:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff89f1bfee4c00 uarg=0000000000000000 20000000:01000000:3.0:1788940448.779225:0:11691:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788940448.779231:0:11691:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788940448.779236:0:11691:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1788940448.785744:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1788940448.785992:0:11691:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1788940448.791735:0:11691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1788940448.791790:0:11691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1788940448.791861:0:11691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1788940448.791878:0:11691:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788940448.791899:0:11691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89f188daa200/0x27a633fcdd4acfb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940448.791918:0:11691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89f1c21f1000/0x27a633fcdd4ab96 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5718 expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940448.791927:0:11691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89f1c21f0200/0x27a633fcdd4ab9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f571f expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940448.791946:0:11691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89f19258d800/0x27a633fcdd4abab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4aba4 expref: 18 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940448.791953:0:11691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89f188daa000/0x27a633fcdd4abb9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4abb2 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940448.791959:0:11691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89f1c21f1e00/0x27a633fcdd4abc7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4abc0 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940448.791967:0:11691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89f188daa200/0x27a633fcdd4acfb lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940448.792027:0:11691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89f1c21f1e00/0x27a633fcdd4abc7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27a633fcdd4abc0 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940448.792043:0:11691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89f1c21f1e00/0x27a633fcdd4abc7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27a633fcdd4abc0 expref: 18 pid: 5853 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940448.792058:0:11691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4cd3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11691:1875839738242816:0@lo:104: 00000100:00100000:2.0:1788940448.792741:0:11691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788940448.792824:0:11691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89f188daa000/0x27a633fcdd4abb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27a633fcdd4abb2 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940448.792846:0:11691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89f188daa000/0x27a633fcdd4abb9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27a633fcdd4abb2 expref: 18 pid: 5853 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940448.792856:0:11691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b48a6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11691:1875839738242944:0@lo:104: 00000100:00100000:2.0:1788940448.792881:0:11691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940448.792893:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738242816 00000100:00100000:3.0:1788940448.792903:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738242816 00010000:00010000:2.0:1788940448.792905:0:11691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89f19258d800/0x27a633fcdd4abab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27a633fcdd4aba4 expref: 18 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940448.792922:0:11691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89f19258d800/0x27a633fcdd4abab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27a633fcdd4aba4 expref: 18 pid: 5854 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940448.792930:0:11691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b48a5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11691:1875839738243072:0@lo:104: 00000100:00100000:3.0:1788940448.792955:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738242944 00000100:00100000:2.0:1788940448.792955:0:11691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940448.792957:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738242944 00000100:00100000:3.0:1788940448.792975:0:8469:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:2.0:1788940448.792981:0:11691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89f1c21f0200/0x27a633fcdd4ab9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f571f expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940448.792986:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738243072 00010000:00010000:2.0:1788940448.792991:0:11691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89f1c21f0200/0x27a633fcdd4ab9d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f571f expref: 12 pid: 5855 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940448.792993:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738243072 00000100:00100000:2.0:1788940448.793001:0:11691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b48a4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11691:1875839738243200:192.168.202.14@tcp:104: 00000100:00100000:3.0:1788940448.793011:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788940448.793019:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+5:11691:x1875839738242816:12345-0@lo:104: 00010000:00010000:3.0:1788940448.793046:0:8469:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff89f188dab000/0x27a633fcdd4abc0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4abc7 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940448.793055:0:11691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89f1c21f1000/0x27a633fcdd4ab96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5718 expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940448.793061:0:11691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89f1c21f1000/0x27a633fcdd4ab96 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5718 expref: 12 pid: 5855 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940448.793069:0:11691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b48a4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11691:1875839738243328:192.168.202.14@tcp:104: 00010000:00010000:3.0:1788940448.793098:0:8469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788940448.793104:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+5:11691:x1875839738242816:12345-0@lo:104: Request processed in 86us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940448.793111:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788940448.793131:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788940448.793137:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b48a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+4:11691:x1875839738242944:12345-0@lo:104: 00010000:00010000:3.0:1788940448.793145:0:8469:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff89f19258d200/0x27a633fcdd4abb2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4abb9 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940448.793178:0:8469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788940448.793183:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b48a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+4:11691:x1875839738242944:12345-0@lo:104: Request processed in 47us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940448.793188:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788940448.793199:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788940448.793206:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b55f9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+3:11691:x1875839738243072:12345-0@lo:104: 00010000:00010000:3.0:1788940448.793212:0:8469:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff89f19258ce00/0x27a633fcdd4aba4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4abab expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940448.793243:0:8469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788940448.793248:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b55f9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+3:11691:x1875839738243072:12345-0@lo:104: Request processed in 43us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940448.793253:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1788940448.793316:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788940448.793322:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff89f188dab000/0x27a633fcdd4abc0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4abc7 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940448.793329:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188dab000 already unused, calling callback (ffffffffc1d10c20) 10000000:00010000:3.0:1788940448.793333:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff89f188dab000/0x27a633fcdd4abc0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x27a633fcdd4abc7 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940448.793341:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff89f188dab000/0x27a633fcdd4abc0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x27a633fcdd4abc7 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788940448.793348:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff89f188dab000/0x27a633fcdd4abc0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x27a633fcdd4abc7 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940448.793354:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788940448.793382:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff89f188dab000/0x27a633fcdd4abc0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4abc7 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940448.793388:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788940448.793407:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff89f188dab000/0x27a633fcdd4abc0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4abc7 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940448.793414:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff89f188dab000/0x27a633fcdd4abc0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4abc7 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940448.793430:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788940448.793433:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff89f19258d200/0x27a633fcdd4abb2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4abb9 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940448.793438:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258d200 already unused, calling callback (ffffffffc1d10c20) 10000000:00010000:3.0:1788940448.793441:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff89f19258d200/0x27a633fcdd4abb2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x27a633fcdd4abb9 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940448.793456:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff89f19258d200/0x27a633fcdd4abb2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x27a633fcdd4abb9 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788940448.793462:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff89f19258d200/0x27a633fcdd4abb2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x27a633fcdd4abb9 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940448.793467:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788940448.793480:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff89f19258d200/0x27a633fcdd4abb2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4abb9 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940448.793486:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788940448.793492:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff89f19258d200/0x27a633fcdd4abb2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4abb9 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940448.793499:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff89f19258d200/0x27a633fcdd4abb2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4abb9 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940448.793508:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940448.793511:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff89f19258ce00/0x27a633fcdd4aba4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4abab expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940448.793544:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258ce00 already unused, calling callback (ffffffffc1d10c20) 10000000:00010000:3.0:1788940448.793547:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff89f19258ce00/0x27a633fcdd4aba4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x27a633fcdd4abab expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940448.793553:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff89f19258ce00/0x27a633fcdd4aba4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x27a633fcdd4abab expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788940448.793558:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff89f19258ce00/0x27a633fcdd4aba4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x27a633fcdd4abab expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940448.793569:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788940448.793582:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff89f19258ce00/0x27a633fcdd4aba4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4abab expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940448.793587:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788940448.793602:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff89f19258ce00/0x27a633fcdd4aba4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4abab expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940448.793609:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff89f19258ce00/0x27a633fcdd4aba4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4abab expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940448.793622:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940448.793624:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940448.793625:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940448.793632:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940448.793652:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf69d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3308:1875839738243584:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788940448.793682:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940448.793705:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788940448.793710:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf69d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3308:1875839738243456:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788940448.793728:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940448.793751:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf69d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3305:1875839738243712:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788940448.793773:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940448.793803:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738243584 00000100:00100000:3.0:1788940448.793807:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738243584 00010000:00010000:3.0:1788940448.793824:0:8470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89f188daa000/0x27a633fcdd4abb9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4abb2 expref: 19 pid: 5853 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940448.793859:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738243456 00000100:00100000:3.0:1788940448.793869:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738243456 00010000:00010000:3.0:1788940448.793883:0:8470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89f1c21f1e00/0x27a633fcdd4abc7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4abc0 expref: 20 pid: 5853 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940448.793893:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738243712 00000100:00100000:3.0:1788940448.793896:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738243712 00010000:00010000:3.0:1788940448.793904:0:8470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89f19258d800/0x27a633fcdd4abab lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4aba4 expref: 21 pid: 5854 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940448.793914:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788940448.793919:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf69df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1220f165-b68f-42ea-b6cd-5f8ad1a18830+21:3308:x1875839738243584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788940448.793928:0:8470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940448.793933:0:8470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89f188daa000/0x27a633fcdd4abb9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4abb2 expref: 21 pid: 5853 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940448.793942:0:8470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89f188daa000/0x27a633fcdd4abb9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27a633fcdd4abb2 expref: 21 pid: 5853 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940448.793955:0:8470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940448.793984:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf69df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1220f165-b68f-42ea-b6cd-5f8ad1a18830+21:3308:x1875839738243584:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940448.793990:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788940448.794004:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788940448.794010:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae81d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1220f165-b68f-42ea-b6cd-5f8ad1a18830+20:3308:x1875839738243456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788940448.794017:0:8470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940448.794021:0:8470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89f1c21f1e00/0x27a633fcdd4abc7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4abc0 expref: 20 pid: 5853 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940448.794030:0:8470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89f1c21f1e00/0x27a633fcdd4abc7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27a633fcdd4abc0 expref: 20 pid: 5853 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940448.794050:0:8470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940448.794073:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae81d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1220f165-b68f-42ea-b6cd-5f8ad1a18830+20:3308:x1875839738243456:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940448.794079:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788940448.794092:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788940448.794097:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1841b5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3305:x1875839738243712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788940448.794104:0:8470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940448.794109:0:8470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89f19258d800/0x27a633fcdd4abab lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4aba4 expref: 19 pid: 5854 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940448.794117:0:8470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89f19258d800/0x27a633fcdd4abab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27a633fcdd4aba4 expref: 19 pid: 5854 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940448.794126:0:8470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940448.794150:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1841b5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3305:x1875839738243712:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940448.794156:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788940448.794209:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf69d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3305:1875839738243712:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788940448.794233:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf69d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3308:1875839738243456:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788940448.794240:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf69d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3308:1875839738243584:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788940448.794494:0:11691:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f195ed3b40 going to sleep for 11 seconds 00010000:00010000:2.0:1788940448.794508:0:11691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f1c21f1e00/0x27a633fcdd4abc7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27a633fcdd4abc0 expref: 18 pid: 5853 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940448.794535:0:11691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4cd3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11691:1875839738242816:0@lo:104: 00010000:00010000:2.0:1788940448.794545:0:11691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f188daa000/0x27a633fcdd4abb9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27a633fcdd4abb2 expref: 17 pid: 5853 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940448.794554:0:11691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b48a6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11691:1875839738242944:0@lo:104: 00010000:00010000:2.0:1788940448.794573:0:11691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f19258d800/0x27a633fcdd4abab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27a633fcdd4aba4 expref: 16 pid: 5854 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940448.794582:0:11691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b48a5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11691:1875839738243072:0@lo:104: 00010000:00010000:1.0:1788940448.796432:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940448.811569:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940448.811605:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940448.812460:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718283776 00000100:00100000:0.0:1788940448.812477:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718283776 00010000:00010000:0.0:1788940448.812567:0:5845:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89f1c21f1000/0x27a633fcdd4ab96 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5718 expref: 13 pid: 5855 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940448.812606:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718283648 00000100:00100000:0.0:1788940448.812609:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718283648 00010000:00010000:0.0:1788940448.812624:0:5845:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89f1c21f0200/0x27a633fcdd4ab9d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f571f expref: 14 pid: 5855 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940448.812648:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 33 00000100:00100000:0.0:1788940448.812658:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae81d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0b05a86-29c8-44a6-9c64-75d9d650043e+14:2352:x1875839718283776:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940448.812676:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940448.812681:0:5845:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89f1c21f1000/0x27a633fcdd4ab96 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5718 expref: 14 pid: 5855 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940448.812710:0:5845:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89f1c21f1000/0x27a633fcdd4ab96 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5718 expref: 14 pid: 5855 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940448.812733:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940448.812800:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae81d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0b05a86-29c8-44a6-9c64-75d9d650043e+14:2352:x1875839718283776:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 143us (1286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940448.812808:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 33 00000100:00100000:0.0:1788940448.812841:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 34 00000100:00100000:0.0:1788940448.812848:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae81c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:2353:x1875839718283648:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940448.812856:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940448.812860:0:5845:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89f1c21f0200/0x27a633fcdd4ab9d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f571f expref: 13 pid: 5855 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940448.812869:0:5845:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89f1c21f0200/0x27a633fcdd4ab9d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f571f expref: 13 pid: 5855 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940448.812881:0:5845:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89f188daa200/0x27a633fcdd4acfb lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940448.812890:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f188daa200/0x27a633fcdd4acfb lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940448.812906:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89f188daa200/0x27a633fcdd4acfb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940448.812913:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89f188daa200/0x27a633fcdd4acfb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940448.812921:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89f188daa200/0x27a633fcdd4acfb lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940448.812933:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89f188daa200/0x27a633fcdd4acfb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940448.812940:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188daa200 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:0.0:1788940448.812944:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89f188daa200/0x27a633fcdd4acfb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940448.812952:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89f188daa200/0x27a633fcdd4acfb lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940448.812962:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89f188daa200/0x27a633fcdd4acfb lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940448.812972:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940448.812990:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae81c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:2353:x1875839718283648:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 143us (1385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940448.812997:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 34 00010000:00010000:2.0:1788940448.815061:0:11691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f1c21f0200/0x27a633fcdd4ab9d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f571f expref: 12 pid: 5855 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940448.815083:0:11691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b48a4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11691:1875839738243200:192.168.202.14@tcp:104: 00010000:00010000:2.0:1788940448.815120:0:11691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f1c21f1000/0x27a633fcdd4ab96 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5718 expref: 11 pid: 5855 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940448.815131:0:11691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b48a4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11691:1875839738243328:192.168.202.14@tcp:104: 00010000:00010000:2.0:1788940448.815172:0:11691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89f188daa200/0x27a633fcdd4acfb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940448.815182:0:11691:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89f188daa200/0x27a633fcdd4acfb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940448.815188:0:11691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89f188daa200/0x27a633fcdd4acfb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940448.815195:0:11691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f188daa200/0x27a633fcdd4acfb lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940449.452905:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788940450.029157:0:5858:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788940450.029167:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89f1bf721000 from 7 10000000:01000000:3.0:1788940450.029173:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788940450.029240:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f180031000/0x27a633fcdd4ad02 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940450.029271:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f180031000/0x27a633fcdd4ad02 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940450.029285:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f180031000/0x27a633fcdd4ad02 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940450.029341:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4f66300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738243840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788940450.029448:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940450.029585:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1baa6b900 going to sleep for 11 seconds 00000100:00100000:2.0:1788940450.031129:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738243840 00000100:00100000:2.0:1788940450.031149:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738243840 00000100:00100000:2.0:1788940450.031236:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1788940450.031247:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1980de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+16:5858:x1875839738243840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788940450.031287:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940450.031461:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f188daa200/0x27a633fcdd4ad09 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4ad02 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940450.031502:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f188daa200/0x27a633fcdd4ad09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4ad02 expref: 17 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940450.031537:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f188daa200/0x27a633fcdd4ad09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4ad02 expref: 17 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940450.031548:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f188daa200, rc 0) 00000100:00100000:2.0:1788940450.031720:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1980de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+17:5858:x1875839738243840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 475us (2272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940450.031728:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788940450.036762:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4f66300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738243840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788940450.036799:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f180031000/0x27a633fcdd4ad02 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4ad09 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940450.036812:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f180031000/0x27a633fcdd4ad02 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4ad09 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940450.037460:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf97d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738243968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788940450.037564:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940450.037690:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f18403d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940450.042226:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738243968 00000100:00100000:2.0:1788940450.042248:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738243968 00000100:00100000:2.0:1788940450.042559:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788940450.042576:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1980dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+17:5858:x1875839738243968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788940450.043122:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1980dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+17:5858:x1875839738243968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 549us (5555us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940450.043132:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788940450.043327:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf97d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738243968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788940450.043390:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf97d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738244096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788940450.043446:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940450.043490:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f18403d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940450.043666:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738244096 00000100:00100000:2.0:1788940450.043674:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738244096 00000100:00100000:2.0:1788940450.043722:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788940450.043732:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1980de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+17:5858:x1875839738244096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788940450.044172:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1980de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+17:5858:x1875839738244096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 440us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940450.044191:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788940450.048648:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf97d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738244096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788940450.051599:0:11704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf97d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:11704:1875839738244224:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788940450.051705:0:11704:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940450.051764:0:11704:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f18403db40 going to sleep for 11 seconds 00000100:00100000:3.0:1788940450.051847:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738244224 00000100:00100000:3.0:1788940450.051859:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738244224 00000100:00100000:3.0:1788940450.052119:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788940450.052134:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1980dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+17:11704:x1875839738244224:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788940450.052424:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1980dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+17:11704:x1875839738244224:12345-0@lo:502:llog_process_th.0 Request processed in 293us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940450.052433:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788940450.052561:0:11704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf97d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:11704:1875839738244224:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788940450.052600:0:11704:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788940450.052612:0:11704:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940450.052615:0:11704:0:(obd_config.c:1662:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788940450.052627:0:11704:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff89f1bf721000 00000020:00000080:0.0:1788940450.052630:0:11704:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788940450.052739:0:11704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf97d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:11704:1875839738244352:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788940450.052781:0:11704:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940450.073017:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738244352 00000100:00100000:2.0:1788940450.073038:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738244352 00000100:00100000:2.0:1788940450.073115:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788940450.073126:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1980dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+17:11704:x1875839738244352:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788940450.073396:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1980dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+17:11704:x1875839738244352:12345-0@lo:502:llog_process_th.0 Request processed in 272us (20614us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940450.073404:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788940450.073504:0:11704:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f18403db40 going to sleep for 11 seconds 00000100:00100000:2.0:1788940450.073558:0:11704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf97d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:11704:1875839738244352:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788940450.073596:0:11704:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788940450.073603:0:11704:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940450.073606:0:11704:0:(obd_config.c:1662:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788940450.073610:0:11704:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788940450.073799:0:5858:0:(obd_config.c:2244:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1788940450.073829:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788940450.073839:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f180031000/0x27a633fcdd4ad02 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4ad09 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940450.073851:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f180031000/0x27a633fcdd4ad02 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4ad09 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940450.073861:0:5858:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788940450.073864:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89f19016d800 from 7 10000000:01000000:2.0:1788940450.073867:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788940450.073897:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f188daa000/0x27a633fcdd4ad10 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940450.075710:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f188daa000/0x27a633fcdd4ad10 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940450.075725:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f188daa000/0x27a633fcdd4ad10 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940450.077159:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b48a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738244480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788940450.077249:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940450.077303:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1baa6b540 going to sleep for 11 seconds 00000100:00100000:2.0:1788940450.077418:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738244480 00000100:00100000:2.0:1788940450.077429:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738244480 00000100:00100000:2.0:1788940450.077482:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788940450.077493:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1980dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+17:5858:x1875839738244480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788940450.077510:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940450.077547:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f188dab200/0x27a633fcdd4ad17 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4ad10 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940450.077579:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f188dab200/0x27a633fcdd4ad17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4ad10 expref: 18 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940450.077591:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f188dab200/0x27a633fcdd4ad17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4ad10 expref: 18 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940450.077601:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f188dab200, rc 0) 00000100:00100000:2.0:1788940450.077650:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1980dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+18:5858:x1875839738244480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940450.077657:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788940450.078245:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b48a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738244480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788940450.078264:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f188daa000/0x27a633fcdd4ad10 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4ad17 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940450.078274:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f188daa000/0x27a633fcdd4ad10 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4ad17 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940450.078374:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4f64e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738244608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788940450.078408:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940450.078442:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1baa6b540 going to sleep for 11 seconds 00000100:00100000:3.0:1788940450.078457:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738244608 00000100:00100000:3.0:1788940450.078461:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738244608 00000100:00100000:3.0:1788940450.078485:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788940450.078492:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1980dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+18:5858:x1875839738244608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788940450.078770:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1980dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+18:5858:x1875839738244608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 277us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940450.078778:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788940450.078806:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4f64e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738244608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788940450.078849:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4f64e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738244736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788940450.078885:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940450.078912:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1baa6b540 going to sleep for 11 seconds 00000100:00100000:2.0:1788940450.080134:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738244736 00000100:00100000:2.0:1788940450.080149:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738244736 00000100:00100000:2.0:1788940450.080188:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788940450.080197:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1980df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+18:5858:x1875839738244736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788940450.080453:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1980df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+18:5858:x1875839738244736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 256us (1566us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940450.080463:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788940450.082091:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4f64e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738244736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788940450.088336:0:11707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b48a4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:11707:1875839738244864:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788940450.088435:0:11707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940450.088499:0:11707:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f186522840 going to sleep for 11 seconds 00000100:00100000:3.0:1788940450.088797:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738244864 00000100:00100000:3.0:1788940450.088809:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738244864 00000100:00100000:3.0:1788940450.088878:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1788940450.088890:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1980df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+18:11707:x1875839738244864:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788940450.089166:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1980df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+18:11707:x1875839738244864:12345-0@lo:502:llog_process_th.0 Request processed in 278us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940450.089174:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788940450.089349:0:11707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b48a4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:11707:1875839738244864:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788940450.089382:0:11707:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788940450.089391:0:11707:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940450.089393:0:11707:0:(obd_config.c:1662:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788940450.089399:0:11707:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff89f19016d800 00000020:00000080:2.0:1788940450.089402:0:11707:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788940450.089499:0:11707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b48a4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:11707:1875839738244992:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788940450.089612:0:11707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940450.089639:0:11707:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f188194180 going to sleep for 11 seconds 00000100:00100000:0.0:1788940450.093367:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738244992 00000100:00100000:0.0:1788940450.093386:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738244992 00000100:00100000:0.0:1788940450.093460:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1788940450.093472:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1980dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+18:11707:x1875839738244992:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788940450.093791:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1980dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+18:11707:x1875839738244992:12345-0@lo:502:llog_process_th.0 Request processed in 321us (4178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940450.093801:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1788940450.094003:0:11707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b48a4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:11707:1875839738244992:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788940450.094044:0:11707:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788940450.094052:0:11707:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940450.094055:0:11707:0:(obd_config.c:1662:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788940450.094060:0:11707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788940450.095458:0:5858:0:(obd_config.c:2244:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1788940450.095489:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788940450.095503:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f188daa000/0x27a633fcdd4ad10 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4ad17 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940450.095563:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f188daa000/0x27a633fcdd4ad10 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4ad17 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940450.095576:0:5858:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788940450.095579:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89f188f09000 from 7 10000000:01000000:0.0:1788940450.095582:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788940450.095624:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f082ad2c00/0x27a633fcdd4ad1e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940450.095631:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f082ad2c00/0x27a633fcdd4ad1e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940450.095642:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f082ad2c00/0x27a633fcdd4ad1e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940450.095668:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf97c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738245120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788940450.095743:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940450.095800:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f18403df00 going to sleep for 11 seconds 00000100:00100000:2.0:1788940450.096952:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738245120 00000100:00100000:2.0:1788940450.096965:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738245120 00000100:00100000:2.0:1788940450.097019:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1788940450.097030:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1980dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+18:5858:x1875839738245120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788940450.097049:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940450.097067:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f188dabc00/0x27a633fcdd4ad25 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4ad1e expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940450.097109:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f188dabc00/0x27a633fcdd4ad25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4ad1e expref: 19 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940450.097120:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f188dabc00/0x27a633fcdd4ad25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4ad1e expref: 19 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940450.097128:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f188dabc00, rc 0) 00000100:00100000:2.0:1788940450.097192:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1980dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:5858:x1875839738245120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 163us (1448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940450.097199:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000040:00080000:3.0:1788940450.098072:0:11708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788940450.098366:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf97c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738245120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788940450.098390:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f082ad2c00/0x27a633fcdd4ad1e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4ad25 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940450.098403:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f082ad2c00/0x27a633fcdd4ad1e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4ad25 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940450.098480:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf97c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738245248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788940450.098556:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940450.098601:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f18403df00 going to sleep for 11 seconds 00000100:00100000:1.0:1788940450.098603:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738245248 00000100:00100000:1.0:1788940450.098611:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738245248 00000100:00100000:1.0:1788940450.098656:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1788940450.098667:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1980de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:5858:x1875839738245248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788940450.098950:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1980de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:5858:x1875839738245248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 284us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940450.098959:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1788940450.099715:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf97c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738245248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788940450.099770:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf97c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738245376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788940450.099836:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940450.099880:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f18403df00 going to sleep for 11 seconds 00000100:00100000:2.0:1788940450.100063:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738245376 00000100:00100000:2.0:1788940450.100071:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738245376 00000100:00100000:2.0:1788940450.100109:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1788940450.100118:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1980df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:5858:x1875839738245376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788940450.100351:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1980df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:5858:x1875839738245376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 232us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940450.100358:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1788940450.100434:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf97c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1220f165-b68f-42ea-b6cd-5f8ad1a18830:5858:1875839738245376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788940450.105207:0:11709:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4f64e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:11709:1875839738245504:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788940450.105301:0:11709:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940450.105346:0:11709:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1baa6be40 going to sleep for 11 seconds 00000100:00100000:2.0:1788940450.105461:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738245504 00000100:00100000:2.0:1788940450.105471:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738245504 00000100:00100000:2.0:1788940450.105593:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1788940450.105605:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1980dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:11709:x1875839738245504:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788940450.105867:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1980dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:11709:x1875839738245504:12345-0@lo:502:llog_process_th.0 Request processed in 262us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940450.105875:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1788940450.106059:0:11709:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4f64e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:11709:1875839738245504:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788940450.106095:0:11709:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788940450.106105:0:11709:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940450.106108:0:11709:0:(obd_config.c:1662:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788940450.106116:0:11709:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff89f188f09000 00000020:00000080:3.0:1788940450.106119:0:11709:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788940450.106221:0:11709:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4f64e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:11709:1875839738245632:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788940450.106258:0:11709:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940450.106282:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738245632 00000100:00100000:3.0:1788940450.106287:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738245632 00000100:00100000:3.0:1788940450.106312:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1788940450.106321:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18415cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:11709:x1875839738245632:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788940450.106471:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18415cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:11709:x1875839738245632:12345-0@lo:502:llog_process_th.0 Request processed in 151us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940450.106479:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1788940450.106548:0:11709:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1baa6be40 going to sleep for 11 seconds 00000100:00100000:3.0:1788940450.106561:0:11709:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4f64e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1220f165-b68f-42ea-b6cd-5f8ad1a18830:11709:1875839738245632:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788940450.106581:0:11709:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788940450.106587:0:11709:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940450.106589:0:11709:0:(obd_config.c:1662:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788940450.106593:0:11709:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788940450.107680:0:5858:0:(obd_config.c:2244:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1788940450.107708:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788940450.107721:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f082ad2c00/0x27a633fcdd4ad1e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4ad25 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940450.107734:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f082ad2c00/0x27a633fcdd4ad1e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4ad25 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940450.480168:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940450.814493:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940450.814562:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940450.814597:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940450.814687:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940450.814764:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718283904 00000100:00100000:3.0:1788940450.814777:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718283904 00000100:00100000:3.0:1788940450.814855:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 276 00000100:00100000:3.0:1788940450.814893:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18415d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+11:5599:x1875839718283904:12345-192.168.202.14@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788940450.814914:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940450.814933:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f180031e00/0x27a633fcdd4ad2c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f576c expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940450.814966:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f180031e00/0x27a633fcdd4ad2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f576c expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940450.814978:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f180031e00/0x27a633fcdd4ad2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f576c expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940450.814987:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f180031e00, rc 0) 00000100:00100000:3.0:1788940450.815047:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18415d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+12:5599:x1875839718283904:12345-192.168.202.14@tcp:101:ll_cfg_requeue.0 Request processed in 158us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940450.815055:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 276 00000100:00100000:0.0:1788940450.815567:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718284032 00000100:00100000:0.0:1788940450.815575:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718284032 00000100:00100000:0.0:1788940450.815622:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718284288 00000100:00100000:0.0:1788940450.815625:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718284288 00000100:00100000:0.0:1788940450.815646:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 121 00000100:00100000:0.0:1788940450.815654:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae7c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+5:2350:x1875839718284032:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788940450.815701:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae7c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+5:2350:x1875839718284032:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 48us (1103us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940450.815709:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 121 00000100:00100000:0.0:1788940450.815722:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 122 00000100:00100000:0.0:1788940450.815728:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae7cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffa310cd-169f-42e3-8999-506116bada08+5:2350:x1875839718284288:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788940450.815751:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae7cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffa310cd-169f-42e3-8999-506116bada08+5:2350:x1875839718284288:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 23us (1064us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940450.815766:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 122 00000100:00100000:2.0:1788940450.816012:0:7074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718284160 00000100:00100000:2.0:1788940450.816023:0:7074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718284160 00000100:00100000:2.0:1788940450.816062:0:7074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 66 00000100:00100000:2.0:1788940450.816070:0:7074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae7c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+5:2350:x1875839718284160:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788940450.816109:0:7074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae7c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+5:2350:x1875839718284160:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 40us (1546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940450.816116:0:7074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 66 00000100:00080000:3.0:1788940450.817102:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788940450.817110:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788940450.826804:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940450.827026:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718284416 00000100:00100000:0.0:1788940450.827042:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718284416 00000100:00100000:0.0:1788940450.827243:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 277 00000100:00100000:0.0:1788940450.827258:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18415f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0b05a86-29c8-44a6-9c64-75d9d650043e+12:5599:x1875839718284416:12345-192.168.202.14@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788940450.827669:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18415f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0b05a86-29c8-44a6-9c64-75d9d650043e+12:5599:x1875839718284416:12345-192.168.202.14@tcp:501:ll_cfg_requeue.0 Request processed in 413us (876us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940450.827678:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 277 00000100:00100000:2.0:1788940450.843880:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940450.844008:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718284544 00000100:00100000:1.0:1788940450.844022:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718284544 00000100:00100000:1.0:1788940450.844078:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 278 00000100:00100000:1.0:1788940450.844089:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18415f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0b05a86-29c8-44a6-9c64-75d9d650043e+12:5599:x1875839718284544:12345-192.168.202.14@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788940450.844355:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18415f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0b05a86-29c8-44a6-9c64-75d9d650043e+12:5599:x1875839718284544:12345-192.168.202.14@tcp:503:ll_cfg_requeue.0 Request processed in 266us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940450.844364:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 278 00000100:00100000:1.0:1788940450.849703:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940450.852042:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718284672 00000100:00100000:0.0:1788940450.852062:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718284672 00000100:00100000:0.0:1788940450.852153:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 279 00000100:00100000:0.0:1788940450.852166:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18415d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0b05a86-29c8-44a6-9c64-75d9d650043e+12:9968:x1875839718284672:12345-192.168.202.14@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788940450.852464:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18415d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0b05a86-29c8-44a6-9c64-75d9d650043e+12:9968:x1875839718284672:12345-192.168.202.14@tcp:502:llog_process_th.0 Request processed in 299us (2775us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940450.852473:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 279 00000100:00100000:0.0:1788940450.868710:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940450.868900:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718284800 00000100:00100000:1.0:1788940450.868913:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718284800 00000100:00100000:1.0:1788940450.868979:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 280 00000100:00100000:1.0:1788940450.868992:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18415c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+12:9968:x1875839718284800:12345-192.168.202.14@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788940450.869294:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18415c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+12:9968:x1875839718284800:12345-192.168.202.14@tcp:502:llog_process_th.0 Request processed in 302us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940450.869302:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 280 00000100:00100000:2.0:1788940450.887206:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940450.889221:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718284928 00000100:00100000:1.0:1788940450.889238:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718284928 00000100:00100000:1.0:1788940450.889332:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 281 00000100:00100000:1.0:1788940450.889470:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18415e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0b05a86-29c8-44a6-9c64-75d9d650043e+12:5599:x1875839718284928:12345-192.168.202.14@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788940450.889498:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940450.889546:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f19258de00/0x27a633fcdd4ad33 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5773 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940450.889579:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f19258de00/0x27a633fcdd4ad33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5773 expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940450.889590:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f19258de00/0x27a633fcdd4ad33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5773 expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940450.889599:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f19258de00, rc 0) 00000100:00100000:1.0:1788940450.889675:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18415e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:5599:x1875839718284928:12345-192.168.202.14@tcp:101:ll_cfg_requeue.0 Request processed in 210us (2479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940450.889683:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 281 00000100:00100000:2.0:1788940450.894659:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940450.894829:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718285056 00000100:00100000:0.0:1788940450.894841:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718285056 00000100:00100000:0.0:1788940450.894919:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 282 00000100:00100000:0.0:1788940450.894930:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18415f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:5599:x1875839718285056:12345-192.168.202.14@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788940450.895496:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18415f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:5599:x1875839718285056:12345-192.168.202.14@tcp:501:ll_cfg_requeue.0 Request processed in 566us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940450.895506:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 282 00000100:00100000:0.0:1788940450.913649:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940450.914016:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718285184 00000100:00100000:1.0:1788940450.914029:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718285184 00000100:00100000:1.0:1788940450.914100:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 283 00000100:00100000:1.0:1788940450.914112:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18415ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:5599:x1875839718285184:12345-192.168.202.14@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788940450.914373:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18415ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:5599:x1875839718285184:12345-192.168.202.14@tcp:503:ll_cfg_requeue.0 Request processed in 261us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940450.914389:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 283 00000100:00100000:2.0:1788940450.923033:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940450.923153:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718285312 00000100:00100000:1.0:1788940450.923167:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718285312 00000100:00100000:1.0:1788940450.923232:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 284 00000100:00100000:1.0:1788940450.923245:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18415dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:9970:x1875839718285312:12345-192.168.202.14@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788940450.923645:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18415dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:9970:x1875839718285312:12345-192.168.202.14@tcp:502:llog_process_th.0 Request processed in 401us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940450.923656:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 284 00000100:00100000:2.0:1788940450.958663:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940450.960939:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718285440 00000100:00100000:1.0:1788940450.960957:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718285440 00000100:00100000:1.0:1788940450.961045:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 285 00000100:00100000:1.0:1788940450.961058:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18415c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:9970:x1875839718285440:12345-192.168.202.14@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788940450.961341:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18415c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:9970:x1875839718285440:12345-192.168.202.14@tcp:502:llog_process_th.0 Request processed in 285us (2687us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940450.961350:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 285 00000040:00080000:3.0:1788940451.119590:0:11708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788940451.308895:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae7caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875839738245888:0@lo:400:kworker.0 00000100:00100000:1.0:1788940451.308978:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940451.309037:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738246400:0@lo:400:kworker.0 00000100:00100000:1.0:1788940451.309065:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940451.309098:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788940451.309103:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae7ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875839738246016:0@lo:400:kworker.0 00000100:00100000:1.0:1788940451.309140:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940451.309185:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738246528:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788940451.309213:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940451.309257:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738246528 00000100:00100000:1.0:1788940451.309268:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738246528 00000100:00100000:1.0:1788940451.309356:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788940451.309367:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738246528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788940451.309410:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788940451.309462:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738246528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940451.309469:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1788940451.309498:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788940451.309547:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:1.0:1788940451.309552:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89f1b4cd1880, transno 4294967300 00000100:00100000:1.0:1788940451.309570:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738246528:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788940451.309914:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738245888 00000100:00100000:1.0:1788940451.309920:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738245888 00000100:00100000:1.0:1788940451.309947:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738246016 00000100:00100000:1.0:1788940451.309950:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738246016 00000100:00100000:1.0:1788940451.309974:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788940451.309981:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875839738245888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940451.310019:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875839738245888:12345-0@lo:400:kworker.0 Request processed in 39us (1043us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940451.310026:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788940451.310038:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788940451.310044:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875839738246016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940451.310073:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875839738246016:12345-0@lo:400:kworker.0 Request processed in 30us (933us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940451.310079:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:1.0:1788940451.310097:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940451.310124:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae7ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875839738246016:0@lo:400:kworker.0 00000100:00100000:1.0:1788940451.310135:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae7caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875839738245888:0@lo:400:kworker.0 00000100:00100000:3.0:1788940451.310477:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae7cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3306:1875839738245760:0@lo:400:kworker.0 00000100:00100000:3.0:1788940451.310545:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940451.310582:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae7c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875839738246272:0@lo:400:kworker.0 00000100:00100000:3.0:1788940451.310607:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940451.310629:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788940451.310636:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae7c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738246144:0@lo:400:kworker.0 00000100:00100000:3.0:1788940451.310660:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940451.310735:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738246400 00000100:00100000:0.0:1788940451.310741:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738246400 00000100:00100000:0.0:1788940451.310776:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738246144 00000100:00100000:0.0:1788940451.310780:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738246144 00000100:00100000:0.0:1788940451.310799:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788940451.310820:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738246400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940451.310866:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738246400:12345-0@lo:400:kworker.0 Request processed in 48us (1799us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940451.310873:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788940451.310885:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788940451.310891:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738246144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940451.311445:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738246144:12345-0@lo:400:kworker.0 Request processed in 553us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940451.311453:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788940451.311459:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738246272 00000100:00100000:3.0:1788940451.311469:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738246272 00000100:00100000:3.0:1788940451.311497:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788940451.311504:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875839738246272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940451.311558:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875839738246272:12345-0@lo:400:kworker.0 Request processed in 53us (949us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940451.311564:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:3.0:1788940451.311604:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788940451.311608:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788940451.311643:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1b5c6df80 x1875839738246400/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940451.311656:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738246400:0@lo:400:kworker.0 00000100:00100000:3.0:1788940451.311690:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae7c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738246144:0@lo:400:kworker.0 00000100:00100000:3.0:1788940451.311700:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae7c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875839738246272:0@lo:400:kworker.0 00000100:00100000:2.0:1788940451.316063:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738245760 00000100:00100000:2.0:1788940451.316081:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738245760 00000100:00100000:2.0:1788940451.316150:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1788940451.316163:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18415e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3306:x1875839738245760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940451.316271:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18415e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3306:x1875839738245760:12345-0@lo:400:kworker.0 Request processed in 110us (5751us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940451.316278:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1788940451.316337:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae7cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3306:1875839738245760:0@lo:400:kworker.0 00010000:00010000:3.0:1788940451.500782:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940452.529400:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940452.845000:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788940452.845027:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738246656:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788940452.845113:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940452.845300:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738246656 00000100:00100000:1.0:1788940452.845322:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738246656 00000100:00100000:1.0:1788940452.845392:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788940452.845404:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf69d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738246656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788940452.845447:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788940452.845511:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf69d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738246656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940452.845538:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:0.0:1788940452.845675:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1b5c6e680 x1875839738246656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940468 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940452.845696:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738246656:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788940453.557080:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940454.573021:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940455.596809:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940455.935637:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940455.935924:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718285568 00000100:00100000:1.0:1788940455.935938:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718285568 00000100:00100000:1.0:1788940455.935997:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 287 00000100:00100000:1.0:1788940455.936008:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18415c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:2353:x1875839718285568:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788940455.936102:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18415c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:2353:x1875839718285568:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 94us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940455.936111:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 287 00000100:00100000:2.0:1788940455.945175:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940455.945231:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940455.945402:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718285824 00000100:00100000:0.0:1788940455.945419:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718285824 00000100:00100000:0.0:1788940455.945580:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 69 00000100:00100000:0.0:1788940455.945594:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b48a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+5:2353:x1875839718285824:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788940455.945683:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b48a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+5:2353:x1875839718285824:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 93us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940455.945690:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 69 00000100:00100000:3.0:1788940455.946458:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718285696 00000100:00100000:3.0:1788940455.946465:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718285696 00000100:00100000:3.0:1788940455.946553:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 126 00000100:00100000:3.0:1788940455.946563:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b48a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+5:2352:x1875839718285696:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788940455.946616:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b48a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+5:2352:x1875839718285696:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 55us (1450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940455.946623:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 126 00000100:00080000:1.0:1788940455.947783:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788940455.947792:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788940455.963486:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940455.963727:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718285952 00000100:00100000:0.0:1788940455.963740:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718285952 00000100:00100000:0.0:1788940455.963852:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 127 00000100:00100000:0.0:1788940455.963864:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b48a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffa310cd-169f-42e3-8999-506116bada08+5:2352:x1875839718285952:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788940455.963950:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b48a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffa310cd-169f-42e3-8999-506116bada08+5:2352:x1875839718285952:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 88us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940455.963957:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 127 00000100:00080000:1.0:1788940455.965038:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940456.431819:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3306:1875839738246784:0@lo:400:kworker.0 00000100:00100000:1.0:1788940456.431911:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940456.431960:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae7c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875839738247296:0@lo:400:kworker.0 00000100:00100000:1.0:1788940456.431989:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940456.432014:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788940456.432036:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae7c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738247168:0@lo:400:kworker.0 00000100:00100000:1.0:1788940456.432078:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940456.432112:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae7cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875839738247040:0@lo:400:kworker.0 00000100:00100000:1.0:1788940456.432139:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940456.432159:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788940456.432165:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875839738246912:0@lo:400:kworker.0 00000100:00100000:1.0:1788940456.432186:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940456.432202:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae7caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738247424:0@lo:400:kworker.0 00000100:00100000:1.0:1788940456.432222:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940456.432254:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738247296 00000100:00100000:1.0:1788940456.432263:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738247296 00000100:00100000:1.0:1788940456.432318:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738247040 00000100:00100000:1.0:1788940456.432321:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738247040 00000100:00100000:1.0:1788940456.432334:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738246912 00000100:00100000:1.0:1788940456.432337:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738246912 00000100:00100000:1.0:1788940456.432353:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788940456.432363:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae7ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875839738247296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940456.432419:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae7ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875839738247296:12345-0@lo:400:kworker.0 Request processed in 57us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940456.432426:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788940456.432445:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788940456.432452:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1aed94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875839738247040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940456.432484:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1aed94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875839738247040:12345-0@lo:400:kworker.0 Request processed in 33us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940456.432490:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788940456.432502:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788940456.432509:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1aed95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875839738246912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940456.432570:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1aed95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875839738246912:12345-0@lo:400:kworker.0 Request processed in 62us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940456.432577:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:1.0:1788940456.432597:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940456.432636:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875839738246912:0@lo:400:kworker.0 00000100:00100000:1.0:1788940456.432648:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae7cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875839738247040:0@lo:400:kworker.0 00000100:00100000:1.0:1788940456.432678:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae7c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875839738247296:0@lo:400:kworker.0 00000100:00100000:1.0:1788940456.432711:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738247168 00000100:00100000:1.0:1788940456.432714:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738247168 00000100:00100000:1.0:1788940456.432744:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738247424 00000100:00100000:1.0:1788940456.432747:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738247424 00000100:00100000:1.0:1788940456.432783:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788940456.432791:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1aed95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738247168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940456.432829:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1aed95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738247168:12345-0@lo:400:kworker.0 Request processed in 39us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940456.432835:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788940456.432846:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788940456.432852:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1aed94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738247424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940456.432882:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1aed94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738247424:12345-0@lo:400:kworker.0 Request processed in 30us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940456.432887:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788940456.432903:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738246784 00000100:00100000:1.0:1788940456.432906:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738246784 00000100:00100000:1.0:1788940456.432925:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1788940456.432931:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18415e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3306:x1875839738246784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940456.432966:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18415e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3306:x1875839738246784:12345-0@lo:400:kworker.0 Request processed in 35us (1056us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940456.432972:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00080000:1.0:1788940456.433001:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788940456.433003:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788940456.433020:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1ae7caa00 x1875839738247424/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940456.433032:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae7caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738247424:0@lo:400:kworker.0 00000100:00100000:1.0:1788940456.433061:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae7c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738247168:0@lo:400:kworker.0 00000100:00100000:1.0:1788940456.433069:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3306:1875839738246784:0@lo:400:kworker.0 00000100:00100000:3.0:1788940456.433213:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788940456.433229:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf69d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738247552:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788940456.433259:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940456.433294:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738247552 00000100:00100000:3.0:1788940456.433298:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738247552 00000100:00100000:3.0:1788940456.433325:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788940456.433332:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf69d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738247552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788940456.433361:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788940456.433395:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf69d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738247552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940456.433401:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788940456.433434:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf69d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738247552:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788940456.621126:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940457.647977:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940457.964948:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788940457.964977:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1aed97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738247680:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788940457.965072:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940457.965268:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738247680 00000100:00100000:1.0:1788940457.965280:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738247680 00000100:00100000:1.0:1788940457.965343:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788940457.965354:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf69d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738247680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788940457.965392:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788940457.965453:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf69d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738247680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940457.965461:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:0.0:1788940457.965572:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1aed97100 x1875839738247680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940473 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940457.965593:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1aed97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738247680:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788940458.673121:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940459.692754:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940460.717297:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940461.053487:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940461.053561:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940461.053654:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718286080 00000100:00100000:2.0:1788940461.053665:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718286080 00000100:00100000:2.0:1788940461.053742:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 289 00000100:00100000:2.0:1788940461.053754:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18415fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:2353:x1875839718286080:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788940461.053841:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18415fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:2353:x1875839718286080:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 89us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940461.053850:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 289 00000100:00100000:1.0:1788940461.053934:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718286208 00000100:00100000:1.0:1788940461.053939:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718286208 00000100:00100000:1.0:1788940461.053990:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 131 00000100:00100000:1.0:1788940461.053999:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf69df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+5:2353:x1875839718286208:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788940461.054031:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf69df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+5:2353:x1875839718286208:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 35us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940461.054056:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 131 00000100:00080000:2.0:1788940461.054176:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788940461.082510:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940461.082600:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940461.082727:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718286336 00000100:00100000:1.0:1788940461.082740:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718286336 00000100:00100000:1.0:1788940461.082826:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 19 00000100:00100000:1.0:1788940461.082838:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b500f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+5:2349:x1875839718286336:12345-192.168.202.14@tcp:9:kworker.0 00000020:00000080:1.0:1788940461.082880:0:6707:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x27a633fcdd4ac6f 00000100:00080000:1.0:1788940461.082892:0:6707:0:(import.c:65:import_set_state_nolock()) ffff89f1b5c5f800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788940461.082940:0:6707:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00080000:2.0:1788940461.083030:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788940461.083192:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718286464 00000100:00100000:0.0:1788940461.083206:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718286464 00000100:00100000:1.0:1788940461.083285:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b500f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+2:2349:x1875839718286336:12345-192.168.202.14@tcp:9:kworker.0 Request processed in 446us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940461.083303:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 19 00000100:00100000:0.0:1788940461.083306:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 132 00000100:00100000:0.0:1788940461.083324:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b500ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffa310cd-169f-42e3-8999-506116bada08+5:2352:x1875839718286464:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788940461.083404:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b500ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffa310cd-169f-42e3-8999-506116bada08+5:2352:x1875839718286464:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 87us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940461.083411:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 132 00000100:00080000:2.0:1788940461.083488:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788940461.083560:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788940461.357596:0:11708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788940461.551157:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b48a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738248192:0@lo:400:kworker.0 00000100:00100000:1.0:1788940461.551261:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940461.551347:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788940461.551355:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b48a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3305:1875839738247808:0@lo:400:kworker.0 00000100:00100000:1.0:1788940461.551384:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940461.551410:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae852a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875839738248320:0@lo:400:kworker.0 00000100:00100000:1.0:1788940461.551446:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940461.551476:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b48a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875839738248064:0@lo:400:kworker.0 00000100:00100000:1.0:1788940461.551497:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940461.551513:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788940461.551543:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b48a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875839738247936:0@lo:400:kworker.0 00000100:00100000:1.0:1788940461.551561:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940461.551576:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae850380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738248448:0@lo:400:kworker.0 00000100:00100000:1.0:1788940461.551615:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940461.551644:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738247808 00000100:00100000:1.0:1788940461.551654:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738247808 00000100:00100000:1.0:1788940461.551750:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1788940461.551760:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18415d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3305:x1875839738247808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940461.551819:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18415d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3305:x1875839738247808:12345-0@lo:400:kworker.0 Request processed in 59us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940461.551825:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1788940461.551859:0:7074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738248192 00000100:00100000:1.0:1788940461.551862:0:7074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738248192 00000100:00100000:1.0:1788940461.551896:0:7074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738248448 00000100:00100000:1.0:1788940461.551899:0:7074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738248448 00000100:00100000:1.0:1788940461.551933:0:7074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788940461.551940:0:7074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1aed97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738248192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940461.551973:0:7074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1aed97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738248192:12345-0@lo:400:kworker.0 Request processed in 35us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940461.551978:0:7074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788940461.551989:0:7074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788940461.551994:0:7074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1aed96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738248448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940461.552024:0:7074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1aed96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738248448:12345-0@lo:400:kworker.0 Request processed in 29us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940461.552029:0:7074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788940461.552045:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738248320 00000100:00100000:1.0:1788940461.552049:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738248320 00000100:00100000:1.0:1788940461.552073:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738248064 00000100:00100000:1.0:1788940461.552076:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738248064 00000100:00100000:1.0:1788940461.552087:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738247936 00000100:00100000:1.0:1788940461.552090:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738247936 00000100:00100000:1.0:1788940461.552114:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788940461.552120:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1aed97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875839738248320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940461.552150:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1aed97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875839738248320:12345-0@lo:400:kworker.0 Request processed in 30us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940461.552156:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788940461.552167:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788940461.552172:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1aed96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875839738248064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940461.552197:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1aed96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875839738248064:12345-0@lo:400:kworker.0 Request processed in 25us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940461.552201:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788940461.552210:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788940461.552216:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1aed96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875839738247936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940461.552237:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1aed96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875839738247936:12345-0@lo:400:kworker.0 Request processed in 22us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940461.552243:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:1.0:1788940461.552268:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788940461.552273:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788940461.552275:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788940461.552307:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b48a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875839738247936:0@lo:400:kworker.0 00010000:00080000:1.0:1788940461.552322:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1ae850380 x1875839738248448/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940461.552331:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae850380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738248448:0@lo:400:kworker.0 00000100:00100000:1.0:1788940461.552340:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b48a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875839738248064:0@lo:400:kworker.0 00000100:00100000:1.0:1788940461.552379:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b48a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3305:1875839738247808:0@lo:400:kworker.0 00000100:00100000:1.0:1788940461.552399:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae852a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875839738248320:0@lo:400:kworker.0 00000100:00100000:1.0:1788940461.552408:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b48a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738248192:0@lo:400:kworker.0 00000100:00100000:2.0:1788940461.553603:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788940461.553620:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae852a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738248576:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788940461.553678:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940461.553742:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738248576 00000100:00100000:2.0:1788940461.553749:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738248576 00000100:00100000:2.0:1788940461.553793:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788940461.553803:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae850380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738248576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788940461.553835:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788940461.553886:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae850380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738248576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940461.553892:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788940461.553946:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae852a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738248576:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788940461.743065:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788940462.182245:0:6732:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9c51ff78-d02d-4e61-8a10-a2f8830f1679 00000020:00000080:2.0:1788940462.182257:0:6732:0:(genops.c:893:class_export_put()) final put ffff89f1901ae800/9c51ff78-d02d-4e61-8a10-a2f8830f1679 00000020:00000080:3.0:1788940462.183119:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1901ae800/9c51ff78-d02d-4e61-8a10-a2f8830f1679 for lustre-OST0000 00000020:00000080:3.0:1788940462.183184:0:36:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff89f1b5c5f800 for lustre-OST0000 00010000:00010000:1.0:1788940462.764859:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940463.086822:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788940463.086857:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1aed94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738248704:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788940463.086966:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940463.088102:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738248704 00000100:00100000:3.0:1788940463.088117:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738248704 00000100:00100000:3.0:1788940463.088232:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788940463.088276:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf97c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738248704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788940463.088332:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788940463.089018:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf97c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738248704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 741us (2048us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940463.089039:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:0.0:1788940463.089274:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788940463.089326:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1aed94e00 x1875839738248704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940479 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940463.089353:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1aed94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738248704:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788940463.788850:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940464.812960:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940465.847191:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940466.169265:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940466.169314:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940466.169346:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940466.169421:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718286720 00000100:00100000:2.0:1788940466.169432:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718286720 00000100:00100000:2.0:1788940466.169501:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718286848 00000100:00100000:2.0:1788940466.169503:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718286848 00000100:00100000:2.0:1788940466.169540:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 136 00000100:00100000:2.0:1788940466.169549:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4cd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+5:2351:x1875839718286720:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788940466.169626:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4cd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+5:2351:x1875839718286720:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 73us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940466.169631:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 136 00000100:00100000:2.0:1788940466.169644:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 137 00000100:00100000:2.0:1788940466.169648:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4cd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffa310cd-169f-42e3-8999-506116bada08+5:2351:x1875839718286848:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788940466.169674:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4cd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffa310cd-169f-42e3-8999-506116bada08+5:2351:x1875839718286848:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 16us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940466.169681:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 137 00000100:00080000:3.0:1788940466.169815:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788940466.170258:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718286592 00000100:00100000:0.0:1788940466.170265:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718286592 00000100:00100000:0.0:1788940466.170305:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 291 00000100:00100000:0.0:1788940466.170321:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:2351:x1875839718286592:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788940466.170365:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:2351:x1875839718286592:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 45us (1050us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940466.170372:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 291 00000100:00100000:2.0:1788940466.670314:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf97f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3306:1875839738248832:0@lo:400:kworker.0 00000100:00100000:2.0:1788940466.670404:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940466.670484:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf97d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875839738249344:0@lo:400:kworker.0 00000100:00100000:2.0:1788940466.670514:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940466.670565:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788940466.670571:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf97d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738249216:0@lo:400:kworker.0 00000100:00100000:2.0:1788940466.670599:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940466.670647:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf97df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875839738248960:0@lo:400:kworker.0 00000100:00100000:2.0:1788940466.670687:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940466.670706:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf97fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738249472:0@lo:400:kworker.0 00000100:00100000:2.0:1788940466.670726:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940466.670741:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788940466.670747:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf97d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875839738249088:0@lo:400:kworker.0 00000100:00100000:2.0:1788940466.670784:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940466.670813:0:7074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738249216 00000100:00100000:2.0:1788940466.670822:0:7074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738249216 00000100:00100000:2.0:1788940466.670874:0:7074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738249472 00000100:00100000:2.0:1788940466.670877:0:7074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738249472 00000100:00100000:2.0:1788940466.670900:0:7074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788940466.670909:0:7074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f198182d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738249216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940466.671334:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738249344 00000100:00100000:0.0:1788940466.671339:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738249344 00000100:00100000:0.0:1788940466.671372:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738248960 00000100:00100000:0.0:1788940466.671375:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738248960 00000100:00100000:0.0:1788940466.671387:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738249088 00000100:00100000:0.0:1788940466.671390:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738249088 00000100:00100000:0.0:1788940466.671405:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788940466.671412:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae852a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875839738249344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940466.671574:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4cd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738249600:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788940466.671645:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738248832 00000100:00100000:1.0:1788940466.671649:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738248832 00000100:00100000:1.0:1788940466.671697:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1788940466.671705:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3306:x1875839738248832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940466.688431:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae852a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875839738249344:12345-0@lo:400:kworker.0 Request processed in 17008us (17904us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940466.688449:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788940466.688491:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788940466.688504:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f198182300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875839738248960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940466.688570:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f198182300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875839738248960:12345-0@lo:400:kworker.0 Request processed in 70us (17881us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940466.688576:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788940466.688587:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788940466.688594:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f198181500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875839738249088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940466.688621:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f198181500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875839738249088:12345-0@lo:400:kworker.0 Request processed in 29us (17836us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940466.688627:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788940466.688708:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf97d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875839738249344:0@lo:400:kworker.0 00000100:00100000:0.0:1788940466.688780:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788940466.688790:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f198181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738249472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940466.688828:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f198181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738249472:12345-0@lo:400:kworker.0 Request processed in 41us (18101us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940466.688833:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1788940466.688991:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788940466.688998:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788940466.689001:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788940466.689075:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf97d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875839738249088:0@lo:400:kworker.0 00000100:00100000:0.0:1788940466.689088:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf97df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875839738248960:0@lo:400:kworker.0 00010000:00080000:0.0:1788940466.689102:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1bf97fb80 x1875839738249472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940466.691337:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf97fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738249472:0@lo:400:kworker.0 00000100:00100000:2.0:1788940466.703793:0:7074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f198182d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738249216:12345-0@lo:400:kworker.0 Request processed in 32874us (33183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940466.703810:0:7074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788940466.706388:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf97d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738249216:0@lo:400:kworker.0 00000100:00100000:3.0:1788940466.706864:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940466.709713:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738249600 00000100:00100000:2.0:1788940466.709730:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738249600 00000100:00100000:2.0:1788940466.709834:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788940466.709847:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f191023480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738249600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788940466.709888:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788940466.709986:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f191023480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738249600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 141us (3122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940466.709993:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788940466.710151:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4cd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738249600:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788940466.724386:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3306:x1875839738248832:12345-0@lo:400:kworker.0 Request processed in 52673us (53973us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940466.724402:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1788940466.724586:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf97f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3306:1875839738248832:0@lo:400:kworker.0 00010000:00010000:3.0:1788940466.862913:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940467.885834:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940468.205203:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1aed96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738249728:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788940468.205287:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940468.206146:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738249728 00000100:00100000:1.0:1788940468.206158:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738249728 00000100:00100000:1.0:1788940468.206250:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788940468.206262:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f198183b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738249728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788940468.206305:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788940468.206367:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f198183b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738249728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (1079us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940468.206374:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:0.0:1788940468.206457:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788940468.206565:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1aed96680 x1875839738249728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940484 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940468.206586:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1aed96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738249728:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788940468.914348:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940469.936886:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940470.957756:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940471.288811:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940471.288854:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940471.288953:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940471.288954:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718287232 00000100:00100000:0.0:1788940471.288966:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718287232 00000100:00080000:3.0:1788940471.289025:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788940471.289043:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718287104 00000100:00100000:0.0:1788940471.289046:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718287104 00000100:00100000:0.0:1788940471.289082:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 141 00000100:00100000:0.0:1788940471.289092:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f191021f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffa310cd-169f-42e3-8999-506116bada08+5:2352:x1875839718287232:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788940471.289181:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f191021f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffa310cd-169f-42e3-8999-506116bada08+5:2352:x1875839718287232:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 90us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940471.289203:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 141 00000100:00100000:0.0:1788940471.289222:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 142 00000100:00100000:0.0:1788940471.289230:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f191021880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+5:2352:x1875839718287104:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788940471.289259:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f191021880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+5:2352:x1875839718287104:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 31us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940471.289265:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 142 00000100:00100000:1.0:1788940471.290402:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718286976 00000100:00100000:1.0:1788940471.290413:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718286976 00000100:00100000:1.0:1788940471.290472:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 293 00000100:00100000:1.0:1788940471.290482:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:2352:x1875839718286976:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788940471.290637:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:2352:x1875839718286976:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 156us (1837us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940471.290659:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 293 00000100:00080000:3.0:1788940471.291497:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1788940471.598761:0:11708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788940471.789511:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1aed94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738250240:0@lo:400:kworker.0 00000100:00100000:1.0:1788940471.789608:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940471.789679:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788940471.789685:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1aed94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3305:1875839738249856:0@lo:400:kworker.0 00000100:00100000:1.0:1788940471.789712:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940471.789735:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1aed97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875839738250368:0@lo:400:kworker.0 00000100:00100000:1.0:1788940471.789759:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940471.789788:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738249856 00000100:00100000:1.0:1788940471.789797:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738249856 00000100:00100000:1.0:1788940471.789857:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1788940471.789867:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3305:x1875839738249856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940471.789921:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3305:x1875839738249856:12345-0@lo:400:kworker.0 Request processed in 56us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940471.789928:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1788940471.789976:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1aed94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3305:1875839738249856:0@lo:400:kworker.0 00000100:00100000:0.0:1788940471.791804:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1aed95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875839738249984:0@lo:400:kworker.0 00000100:00100000:0.0:1788940471.791888:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940471.791931:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1aed95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738250496:0@lo:400:kworker.0 00000100:00100000:0.0:1788940471.791957:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940471.791982:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788940471.791989:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1aed95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875839738250112:0@lo:400:kworker.0 00000100:00100000:0.0:1788940471.792008:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940471.792024:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f191020000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738250624:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788940471.792046:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940471.792091:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738250240 00000100:00100000:0.0:1788940471.792100:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738250240 00000100:00100000:0.0:1788940471.792158:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738250496 00000100:00100000:0.0:1788940471.792161:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738250496 00000100:00100000:0.0:1788940471.792186:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788940471.792196:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1aed96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738250240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940471.792247:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1aed96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738250240:12345-0@lo:400:kworker.0 Request processed in 53us (2639us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940471.792353:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738250368 00000100:00100000:3.0:1788940471.792358:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738250368 00000100:00100000:3.0:1788940471.792400:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738249984 00000100:00100000:3.0:1788940471.792403:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738249984 00000100:00100000:3.0:1788940471.792413:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738250112 00000100:00100000:3.0:1788940471.792415:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738250112 00000100:00100000:3.0:1788940471.792426:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788940471.792432:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1aed94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875839738250368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940471.792482:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1aed94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875839738250368:12345-0@lo:400:kworker.0 Request processed in 51us (2723us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940471.792489:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788940471.792507:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788940471.792513:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf97f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875839738249984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940471.792568:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf97f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875839738249984:12345-0@lo:400:kworker.0 Request processed in 55us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940471.792574:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788940471.792585:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788940471.792591:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf97fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875839738250112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940471.792649:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf97fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875839738250112:12345-0@lo:400:kworker.0 Request processed in 59us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940471.792655:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:3.0:1788940471.792674:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788940471.792679:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788940471.792681:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788940471.792714:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1aed95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875839738250112:0@lo:400:kworker.0 00000100:00100000:3.0:1788940471.792726:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1aed95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875839738249984:0@lo:400:kworker.0 00000100:00100000:0.0:1788940471.793034:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788940471.793057:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788940471.793842:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738250624 00000100:00100000:1.0:1788940471.793851:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738250624 00000100:00100000:1.0:1788940471.793907:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788940471.793916:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf97df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738250624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788940471.793951:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788940471.794007:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf97df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738250624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (1958us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940471.794013:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788940471.794067:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1aed97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875839738250368:0@lo:400:kworker.0 00000100:00100000:1.0:1788940471.794095:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1aed94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738250240:0@lo:400:kworker.0 00000100:00100000:0.0:1788940471.794340:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf97d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738250496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940471.794777:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f191020000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738250624:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1788940471.794792:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1aed95f80 x1875839738250496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940487 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940471.794803:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1aed95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738250496:0@lo:400:kworker.0 00000100:00100000:0.0:1788940471.795999:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf97d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738250496:12345-0@lo:400:kworker.0 Request processed in 2931us (4035us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940471.796011:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00010000:1.0:1788940471.989314:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940473.005748:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940473.326160:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1aed94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738250752:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788940473.326258:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940473.326374:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738250752 00000100:00100000:3.0:1788940473.326384:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738250752 00000100:00100000:3.0:1788940473.326461:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788940473.326472:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f198181880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738250752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788940473.327253:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788940473.327370:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f198181880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738250752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 898us (1109us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940473.327379:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:3.0:1788940473.327413:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788940473.327477:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1aed94700 x1875839738250752/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940489 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940473.327503:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1aed94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738250752:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788940474.029878:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940475.052719:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788940475.415543:0:11877:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 03:54:34 (1788940474) 00010000:00010000:3.0:1788940476.076886:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940476.426783:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940476.426840:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940476.426886:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940476.427000:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718287616 00000100:00100000:1.0:1788940476.427015:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718287616 00000100:00100000:1.0:1788940476.427123:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718287488 00000100:00100000:1.0:1788940476.427127:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718287488 00000100:00100000:1.0:1788940476.427155:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 146 00000100:00100000:1.0:1788940476.427166:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f191020000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffa310cd-169f-42e3-8999-506116bada08+5:2351:x1875839718287616:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788940476.427266:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f191020000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffa310cd-169f-42e3-8999-506116bada08+5:2351:x1875839718287616:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 101us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940476.427275:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 146 00000100:00100000:1.0:1788940476.427296:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 147 00000100:00100000:1.0:1788940476.427303:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f191021c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+5:2351:x1875839718287488:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788940476.427332:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f191021c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+5:2351:x1875839718287488:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 30us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940476.427339:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 147 00000100:00080000:3.0:1788940476.427639:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788940476.427708:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718287360 00000100:00100000:0.0:1788940476.427714:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718287360 00000100:00100000:0.0:1788940476.427758:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 295 00000100:00100000:0.0:1788940476.427766:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:2351:x1875839718287360:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788940476.427799:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:2351:x1875839718287360:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 34us (1033us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940476.427805:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 295 00000100:00100000:1.0:1788940476.909627:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1aed97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875839738251136:0@lo:400:kworker.0 00000100:00100000:1.0:1788940476.909735:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940476.909820:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788940476.909828:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1aed94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875839738251008:0@lo:400:kworker.0 00000100:00100000:1.0:1788940476.909854:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940476.909873:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1aed95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738251520:0@lo:400:kworker.0 00000100:00100000:1.0:1788940476.909918:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940476.909956:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738251520 00000100:00100000:1.0:1788940476.909965:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738251520 00000100:00100000:1.0:1788940476.910230:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788940476.910242:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b48a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738251520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940476.910304:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b48a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738251520:12345-0@lo:400:kworker.0 Request processed in 64us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940476.910312:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788940476.910339:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738251136 00000100:00100000:1.0:1788940476.910344:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738251136 00000100:00100000:1.0:1788940476.910371:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738251008 00000100:00100000:1.0:1788940476.910374:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738251008 00000100:00100000:1.0:1788940476.910396:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788940476.910404:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1aed95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875839738251136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940476.910437:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1aed95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875839738251136:12345-0@lo:400:kworker.0 Request processed in 34us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940476.910443:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788940476.910455:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788940476.910462:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b48a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875839738251008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940476.910490:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b48a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875839738251008:12345-0@lo:400:kworker.0 Request processed in 28us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940476.910496:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788940476.910578:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1aed94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875839738251008:0@lo:400:kworker.0 00010000:00080000:1.0:1788940476.910595:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1aed95180 x1875839738251520/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940492 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940476.910607:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1aed95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738251520:0@lo:400:kworker.0 00000100:00100000:1.0:1788940476.910629:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1aed97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875839738251136:0@lo:400:kworker.0 00000100:00100000:2.0:1788940476.910760:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1aed94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738251264:0@lo:400:kworker.0 00000100:00100000:2.0:1788940476.910818:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940476.910863:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788940476.910876:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1aed97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3305:1875839738250880:0@lo:400:kworker.0 00000100:00100000:2.0:1788940476.910917:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940476.910938:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1aed95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875839738251392:0@lo:400:kworker.0 00000100:00100000:2.0:1788940476.910971:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940476.911495:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788940476.911506:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f191020a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738251648:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788940476.911580:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940476.911614:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738251648 00000100:00100000:3.0:1788940476.911619:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738251648 00000100:00100000:3.0:1788940476.911661:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788940476.911669:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f191023100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738251648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788940476.911705:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788940476.911761:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f191023100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738251648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940476.911768:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:3.0:1788940476.911799:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788940476.911805:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788940476.911807:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788940476.911840:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f191020a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738251648:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788940476.912006:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738251264 00000100:00100000:0.0:1788940476.912022:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738251264 00000100:00100000:0.0:1788940476.912073:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788940476.912082:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f198183800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738251264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940476.912127:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f198183800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738251264:12345-0@lo:400:kworker.0 Request processed in 47us (1308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940476.912142:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788940476.912168:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738251392 00000100:00100000:0.0:1788940476.912172:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738251392 00000100:00100000:0.0:1788940476.912212:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788940476.912219:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f198183100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875839738251392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940476.912258:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f198183100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875839738251392:12345-0@lo:400:kworker.0 Request processed in 39us (1286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940476.912271:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:0.0:1788940476.912296:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788940476.912319:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1aed95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875839738251392:0@lo:400:kworker.0 00000100:00100000:0.0:1788940476.912330:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1aed94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738251264:0@lo:400:kworker.0 00000100:00100000:1.0:1788940476.914373:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738250880 00000100:00100000:1.0:1788940476.914391:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738250880 00000100:00100000:1.0:1788940476.914465:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1788940476.914477:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3305:x1875839738250880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940476.914616:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3305:x1875839738250880:12345-0@lo:400:kworker.0 Request processed in 141us (3697us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940476.914624:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1788940476.921394:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1aed97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3305:1875839738250880:0@lo:400:kworker.0 00010000:00010000:1.0:1788940477.105585:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940477.643851:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940477.643997:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718287744 00000100:00100000:1.0:1788940477.644020:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718287744 00000100:00100000:1.0:1788940477.644262:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 32 00000100:00100000:1.0:1788940477.644275:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f0821c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+5:10240:x1875839718287744:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788940477.644305:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940477.644338:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4ad3a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f577a expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940477.644426:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4ad41 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940477.644443:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4ad41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940477.644459:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4ad41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940477.644503:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788940477.644507:0:5861:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788940477.644630:0:5861:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4ad41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940477.644660:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4ad3a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f577a expref: 7 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940477.644682:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4ad41 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f577a expref: 6 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940477.644691:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f188f81300) 00010000:00010000:1.0:1788940477.644694:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788940477.644698:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f19258d400, rc 0) 00000100:00100000:1.0:1788940477.644775:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f0821c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:10240:x1875839718287744:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 502us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940477.644782:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 32 00000100:00100000:0.0:1788940477.669846:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940477.670409:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718287872 00000100:00100000:1.0:1788940477.670424:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718287872 00000100:00100000:1.0:1788940477.670502:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 33 00000100:00100000:1.0:1788940477.670514:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf97d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:10241:x1875839718287872:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788940477.670588:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940477.670616:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4ad48 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5781 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940477.670698:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258cc00/0x27a633fcdd4ad4f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940477.670715:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258cc00/0x27a633fcdd4ad4f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940477.670753:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258cc00/0x27a633fcdd4ad4f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940477.670772:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4ad56 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940477.670780:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4ad56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940477.670787:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4ad56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940477.671663:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d200/0x27a633fcdd4ad5d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940477.671679:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d200/0x27a633fcdd4ad5d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940477.671688:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d200/0x27a633fcdd4ad5d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940477.671727:0:5860:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788940477.671731:0:5860:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788940477.671758:0:5860:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d200/0x27a633fcdd4ad5d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940477.671771:0:5860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258cc00/0x27a633fcdd4ad4f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940477.671779:0:5860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258cc00/0x27a633fcdd4ad4f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940477.671800:0:5860:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258cc00/0x27a633fcdd4ad4f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940477.671806:0:5860:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258cc00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940477.671811:0:5860:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258cc00/0x27a633fcdd4ad4f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940477.671821:0:5860:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258cc00/0x27a633fcdd4ad4f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940477.671834:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f188f81300) 00010000:00010000:1.0:1788940477.671837:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940477.671843:0:5860:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258cc00/0x27a633fcdd4ad4f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940477.671850:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258cc00/0x27a633fcdd4ad4f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940477.671877:0:5860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4ad56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940477.671884:0:5860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4ad56 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940477.671890:0:5860:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4ad56 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940477.671895:0:5860:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258c000 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940477.671898:0:5860:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4ad56 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940477.671913:0:5860:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4ad56 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940477.671922:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff89f188f81600) 00010000:00010000:1.0:1788940477.671924:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940477.671928:0:5860:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4ad56 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940477.671935:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4ad56 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940477.671986:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4ad48 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5781 expref: 8 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940477.672001:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d200/0x27a633fcdd4ad5d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5781 expref: 7 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940477.673400:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff89f188f81800) 00010000:00010000:1.0:1788940477.673404:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788940477.673408:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f19258d200, rc 0) 00000100:00100000:1.0:1788940477.673513:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf97d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+7:10241:x1875839718287872:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 2997us (3680us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940477.673543:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 33 00000100:00100000:0.0:1788940477.684666:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940477.685922:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718288128 00000100:00100000:2.0:1788940477.685939:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718288128 00000100:00100000:2.0:1788940477.686036:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 34 00000100:00100000:2.0:1788940477.686048:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf97d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+7:10241:x1875839718288128:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788940477.686091:0:7857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940477.686123:0:7857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4ad64 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5788 expref: -99 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940477.686753:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4ad6b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940477.686776:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4ad6b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940477.686792:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4ad6b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940477.703178:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daae00/0x27a633fcdd4ad72 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940477.703204:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daae00/0x27a633fcdd4ad72 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940477.703218:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daae00/0x27a633fcdd4ad72 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940477.703606:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab000/0x27a633fcdd4ad79 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940477.703617:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab000/0x27a633fcdd4ad79 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940477.703626:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab000/0x27a633fcdd4ad79 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940477.703637:0:7857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1788940477.703782:0:7857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4ad6b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940477.703790:0:7857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4ad6b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940477.703797:0:7857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4ad6b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940477.703803:0:7857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188daa400 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940477.703808:0:7857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4ad6b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940477.703827:0:7857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4ad6b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940477.703838:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff89f188f81800) 00010000:00010000:2.0:1788940477.703841:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940477.703846:0:7857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4ad6b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940477.703853:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4ad6b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940477.703867:0:7857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daae00/0x27a633fcdd4ad72 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940477.703872:0:7857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daae00/0x27a633fcdd4ad72 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940477.703878:0:7857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daae00/0x27a633fcdd4ad72 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940477.703884:0:7857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188daae00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940477.703887:0:7857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daae00/0x27a633fcdd4ad72 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940477.703893:0:7857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daae00/0x27a633fcdd4ad72 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940477.703899:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff89f186946d00) 00010000:00010000:2.0:1788940477.703901:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940477.703903:0:7857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daae00/0x27a633fcdd4ad72 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940477.704245:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daae00/0x27a633fcdd4ad72 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940477.706289:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4ad64 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5788 expref: 10 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940477.706313:0:7857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab000/0x27a633fcdd4ad79 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5788 expref: 9 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940477.706322:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89f186946200) 00010000:00010000:2.0:1788940477.706325:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940477.706328:0:7857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f188dab000, rc 0) 00000100:00100000:2.0:1788940477.706410:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf97d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+9:10241:x1875839718288128:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 20363us (21758us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788940477.706421:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 34 00000100:00100000:2.0:1788940477.725030:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940477.725685:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718288256 00000100:00100000:1.0:1788940477.725701:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718288256 00000100:00100000:1.0:1788940477.725779:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 35 00000100:00100000:1.0:1788940477.725792:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f0821c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+9:10241:x1875839718288256:12345-192.168.202.14@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788940477.726027:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f0821c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+9:10241:x1875839718288256:12345-192.168.202.14@tcp:59:lhsmtool_posix.0 Request processed in 238us (1005us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940477.726035:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 35 00000040:00080000:1.0:1788940477.748413:0:11708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788940478.124709:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940478.446827:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788940478.446857:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b48a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738251776:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788940478.446955:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940478.447415:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738251776 00000100:00100000:1.0:1788940478.447428:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738251776 00000100:00100000:1.0:1788940478.447510:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788940478.447562:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f191020a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738251776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788940478.447619:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788940478.447685:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f191020a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738251776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 167us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940478.447693:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:1.0:1788940478.447741:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1b48a4a80 x1875839738251776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940494 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940478.447761:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b48a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738251776:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788940478.447909:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788940479.149091:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940480.180160:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940480.585478:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940480.587059:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718288384 00000100:00100000:1.0:1788940480.587072:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718288384 00000100:00100000:1.0:1788940480.587154:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 36 00000100:00080000:2.0:1788940480.587163:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940480.587170:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf97f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+9:10283:x1875839718288384:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:1.0:1788940480.587192:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940480.587214:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4ad87 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f578f expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.587278:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4ad8e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.587303:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4ad8e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.587314:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4ad8e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.587329:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ca00/0x27a633fcdd4ad95 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.587336:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ca00/0x27a633fcdd4ad95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.587342:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ca00/0x27a633fcdd4ad95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.587898:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4ad8e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.587906:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4ad8e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.587913:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4ad8e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.587918:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258d000 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940480.587922:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4ad8e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.587929:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4ad8e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.587942:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f188f81300) 00010000:00010000:1.0:1788940480.587951:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940480.587956:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4ad8e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.587963:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4ad8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.587975:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ca00/0x27a633fcdd4ad95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.587980:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ca00/0x27a633fcdd4ad95 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.587987:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ca00/0x27a633fcdd4ad95 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.587991:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258ca00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940480.587994:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ca00/0x27a633fcdd4ad95 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.588000:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ca00/0x27a633fcdd4ad95 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.588007:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff89f188f81f00) 00010000:00010000:1.0:1788940480.588010:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940480.588013:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ca00/0x27a633fcdd4ad95 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.588019:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ca00/0x27a633fcdd4ad95 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.588050:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4ad87 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f578f expref: 10 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.588071:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f188f81300) 00010000:00010000:1.0:1788940480.588074:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940480.588077:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4ad87 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f578f expref: 10 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.588086:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f19258c400, rc 0) 00000100:00100000:1.0:1788940480.588170:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf97f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+9:10283:x1875839718288384:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 1005us (2698us total) trans 0 rc 301/301 00000100:00100000:1.0:1788940480.588177:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 36 00000100:00100000:3.0:1788940480.614772:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940480.615065:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718288640 00000100:00100000:1.0:1788940480.615078:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718288640 00000100:00100000:1.0:1788940480.615183:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 37 00000100:00100000:1.0:1788940480.615196:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f191023800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+9:10283:x1875839718288640:12345-192.168.202.14@tcp:36:lfs.0 00010000:00010000:1.0:1788940480.615259:0:5862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940480.615290:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4ad41 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f577a expref: 9 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.615313:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f188f81300) 00010000:00010000:1.0:1788940480.615326:0:5862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788940480.615668:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4ad9c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.615683:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4ad9c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.615693:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4ad9c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.615719:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ce00/0x27a633fcdd4ada3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.615728:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ce00/0x27a633fcdd4ada3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.615734:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ce00/0x27a633fcdd4ada3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940480.618266:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788940480.618284:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4ad9c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.618294:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4ad9c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.618301:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4ad9c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.618307:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258d800 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940480.618312:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4ad9c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.618321:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4ad9c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.618338:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f188f81200) 00010000:00010000:1.0:1788940480.618340:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940480.620266:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4ad9c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.620304:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4ad9c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788940480.620330:0:5862:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000dd3ae51 reply state 00000000fd76fcab transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ce00/0x27a633fcdd4ada3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940480.620340:0:5862:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788940480.620502:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f191023800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+10:10283:x1875839718288640:12345-192.168.202.14@tcp:36:lfs.0 Request processed in 5305us (5736us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788940480.620512:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 37 00010000:00010000:3.0:1788940480.630991:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ce00/0x27a633fcdd4ada3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940480.631010:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ce00/0x27a633fcdd4ada3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940480.631018:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ce00/0x27a633fcdd4ada3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940480.631025:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258ce00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940480.631030:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ce00/0x27a633fcdd4ada3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940480.631038:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ce00/0x27a633fcdd4ada3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940480.631055:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff89f188f81b00) 00010000:00010000:3.0:1788940480.631058:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940480.631063:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ce00/0x27a633fcdd4ada3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940480.631069:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ce00/0x27a633fcdd4ada3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940480.793942:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940480.799916:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718288768 00000100:00100000:0.0:1788940480.799932:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718288768 00000100:00100000:0.0:1788940480.800006:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 38 00000100:00100000:0.0:1788940480.800017:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f191023b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+9:10291:x1875839718288768:12345-192.168.202.14@tcp:101:lctl.0 00010000:00010000:0.0:1788940480.800043:0:7857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940480.800064:0:7857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4adaa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5796 expref: -99 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940480.800125:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3400/0x27a633fcdd4adb1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940480.800139:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3400/0x27a633fcdd4adb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940480.800150:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3400/0x27a633fcdd4adb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940480.800186:0:7857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788940480.800189:0:7857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788940480.800225:0:7857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3400/0x27a633fcdd4adb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940480.800264:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4adaa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5796 expref: 11 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940480.800278:0:7857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3400/0x27a633fcdd4adb1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5796 expref: 10 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940480.800287:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f1983af400) 00010000:00010000:0.0:1788940480.800290:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788940480.800293:0:7857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f082ad3400, rc 0) 00000100:00100000:0.0:1788940480.800362:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f191023b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+10:10291:x1875839718288768:12345-192.168.202.14@tcp:101:lctl.0 Request processed in 347us (6441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940480.800369:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 38 00000100:00100000:0.0:1788940480.914922:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940480.917425:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718288896 00000100:00100000:1.0:1788940480.917444:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718288896 00000100:00100000:1.0:1788940480.918053:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 39 00000100:00100000:1.0:1788940480.918068:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf97f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+10:10297:x1875839718288896:12345-192.168.202.14@tcp:101:bash.0 00010000:00010000:1.0:1788940480.918091:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940480.918116:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4adb8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f579d expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.918186:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4adbf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.918201:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4adbf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.918212:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4adbf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.918225:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4adc6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.918251:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4adc6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.918257:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4adc6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.918356:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ca00/0x27a633fcdd4adcd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.918363:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ca00/0x27a633fcdd4adcd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.918370:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ca00/0x27a633fcdd4adcd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940480.918396:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788940480.918399:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788940480.918441:0:5862:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ca00/0x27a633fcdd4adcd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.918451:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4adbf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.918457:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4adbf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.918464:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4adbf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.918471:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258d400 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940480.918475:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4adbf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.918490:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4adbf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.918502:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f1983af400) 00010000:00010000:1.0:1788940480.918505:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940480.918511:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4adbf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.920409:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4adbf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.920442:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4adc6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.920449:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4adc6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.920456:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4adc6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.920463:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258c400 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940480.920467:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4adc6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.920475:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4adc6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.920488:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff89f188f81200) 00010000:00010000:1.0:1788940480.920491:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940480.920495:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4adc6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.920609:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4adc6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.920659:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4adb8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f579d expref: 12 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.920672:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ca00/0x27a633fcdd4adcd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f579d expref: 11 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.920679:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89f188f81300) 00010000:00010000:1.0:1788940480.920681:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788940480.920684:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f19258ca00, rc 0) 00000100:00100000:1.0:1788940480.920818:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf97f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+11:10297:x1875839718288896:12345-192.168.202.14@tcp:101:bash.0 Request processed in 2754us (5908us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940480.920828:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 39 00000100:00100000:0.0:1788940480.930136:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940480.930400:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718289152 00000100:00100000:2.0:1788940480.930413:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718289152 00000100:00100000:2.0:1788940480.930482:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 40 00000100:00100000:2.0:1788940480.930493:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+11:10297:x1875839718289152:12345-192.168.202.14@tcp:101:bash.0 00010000:00010000:2.0:1788940480.930606:0:7857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940480.930633:0:7857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4add4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f57a4 expref: -99 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940480.930784:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4addb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940480.930816:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4addb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940480.930828:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4addb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940480.930877:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa800/0x27a633fcdd4ade2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940480.930886:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa800/0x27a633fcdd4ade2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940480.930892:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa800/0x27a633fcdd4ade2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788940480.931484:0:7857:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:2.0:1788940480.931702:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4ade9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940480.931713:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4ade9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940480.931721:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4ade9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940480.931756:0:7857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4addb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940480.931764:0:7857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4addb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940480.931771:0:7857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4addb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940480.931785:0:7857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188daac00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940480.931790:0:7857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4addb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940480.931799:0:7857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4addb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940480.931813:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89f188f81300) 00010000:00010000:2.0:1788940480.931816:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940480.931820:0:7857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4addb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940480.931827:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4addb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788940480.931842:0:7857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b45de60c reply state 000000005796e342 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa800/0x27a633fcdd4ade2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940480.931850:0:7857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788940480.931883:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4add4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57a4 expref: 14 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940480.931898:0:7857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4ade9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57a4 expref: 13 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940480.931906:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89f186946800) 00010000:00010000:2.0:1788940480.931908:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788940480.931910:0:7857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f188dab400, rc 0) 00000100:00100000:2.0:1788940480.932754:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+14:10297:x1875839718289152:12345-192.168.202.14@tcp:101:bash.0 Request processed in 2258us (2624us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788940480.932926:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 40 00010000:00010000:1.0:1788940480.937338:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa800/0x27a633fcdd4ade2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.937355:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa800/0x27a633fcdd4ade2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.937363:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa800/0x27a633fcdd4ade2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.937369:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188daa800 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940480.937374:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa800/0x27a633fcdd4ade2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.937384:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa800/0x27a633fcdd4ade2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.937417:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff89f186946d00) 00010000:00010000:1.0:1788940480.937420:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940480.937425:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa800/0x27a633fcdd4ade2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.937432:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa800/0x27a633fcdd4ade2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940480.942639:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940480.942868:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718289280 00000100:00100000:1.0:1788940480.942880:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718289280 00000100:00100000:1.0:1788940480.942929:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 20 00000100:00100000:1.0:1788940480.942938:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf581c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2349:x1875839718289280:12345-192.168.202.14@tcp:8:bash.0 00010000:00080000:1.0:1788940480.942984:0:6707:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 9c51ff78-d02d-4e61-8a10-a2f8830f1679@192.168.202.14@tcp t0 exp 0000000000000000 cur 423 last 0 00000020:00000080:1.0:1788940480.943111:0:6707:0:(genops.c:1393:class_connect()) connect: client 9c51ff78-d02d-4e61-8a10-a2f8830f1679, cookie 0x27a633fcdd4adf7 00002000:00100000:1.0:1788940480.943124:0:6707:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9c51ff78-d02d-4e61-8a10-a2f8830f1679/ffff89f0841e5800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788940480.943147:0:6707:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788940480.943402:0:6707:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788940480.943439:0:6707:0:(import.c:65:import_set_state_nolock()) ffff89f1bf722800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788940480.945296:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf581c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2349:x1875839718289280:12345-192.168.202.14@tcp:8:bash.0 Request processed in 581us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940480.945311:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 20 00000100:00100000:0.0:1788940480.963614:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940480.964389:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718289408 00000100:00100000:1.0:1788940480.964402:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718289408 00000100:00100000:1.0:1788940480.964484:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 21 00000100:00100000:1.0:1788940480.964494:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf580a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:0:x1875839718289408:12345-192.168.202.14@tcp:101:bash.0 00010000:00010000:1.0:1788940480.964514:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940480.964732:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf131944/0x27a633fcdd4adfe lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f57ab expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788940480.964760:0:6705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788940480.964780:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=423s v=(0 0) 00010000:00010000:1.0:1788940480.964784:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940480.964794:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf131944/0x27a633fcdd4adfe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57ab expref: 7 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.964816:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bf131944/0x27a633fcdd4adfe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57ab expref: 7 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.964833:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f19258d800, rc 0) 00000100:00080000:2.0:1788940480.965265:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788940480.965804:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf580a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+7:0:x1875839718289408:12345-192.168.202.14@tcp:101:bash.0 Request processed in 1306us (2195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940480.965813:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 21 00000100:00100000:3.0:1788940480.971468:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940480.973025:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718289536 00000100:00100000:0.0:1788940480.973041:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718289536 00000100:00100000:0.0:1788940480.973133:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 22 00000100:00100000:0.0:1788940480.973145:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f191022d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+7:10297:x1875839718289536:12345-192.168.202.14@tcp:101:bash.0 00010000:00010000:0.0:1788940480.973165:0:6708:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940480.973189:0:6708:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000133c7c80/0x27a633fcdd4ae05 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f57b2 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940480.973225:0:6708:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bf131944/0x27a633fcdd4adfe lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57ab expref: 8 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940480.973254:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940480.973259:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940480.973266:0:6708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000133c7c80/0x27a633fcdd4ae05 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57b2 expref: 8 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940480.973600:0:6708:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bf131944/0x27a633fcdd4adfe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57ab expref: 8 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940480.973617:0:6708:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bf131944/0x27a633fcdd4adfe lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57ab expref: 8 pid: 6705 timeout: 523 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940480.973633:0:6708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf583100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6708:1875839738251904:192.168.202.14@tcp:104: 00000100:00100000:0.0:1788940480.973749:0:6708:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f18dd30240 going to sleep for 11 seconds 00000100:00100000:2.0:1788940480.981918:0:6708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf583100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6708:1875839738251904:192.168.202.14@tcp:104: 00010000:00010000:2.0:1788940480.981967:0:6708:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000133c7c80/0x27a633fcdd4ae05 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57b2 expref: 8 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940480.981995:0:6708:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f082ad3800, rc 0) 00000100:00100000:2.0:1788940480.982066:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f191022d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+8:10297:x1875839718289536:12345-192.168.202.14@tcp:101:bash.0 Request processed in 8923us (10607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940480.982076:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 22 00000100:00100000:0.0:1788940480.982481:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940480.982613:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718289664 00000100:00100000:1.0:1788940480.982622:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718289664 00010000:00010000:1.0:1788940480.982663:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bf131944/0x27a633fcdd4adfe lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57ab expref: 8 pid: 6705 timeout: 523 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940480.982700:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 35 00000100:00100000:1.0:1788940480.982709:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf583800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+8:2353:x1875839718289664:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788940480.982750:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940480.982776:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bf131944/0x27a633fcdd4adfe lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57ab expref: 8 pid: 6705 timeout: 523 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.982803:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bf131944/0x27a633fcdd4adfe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57ab expref: 8 pid: 6705 timeout: 523 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.982829:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf131944/0x27a633fcdd4adfe lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57ab expref: 8 pid: 6705 timeout: 523 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.982845:0:5847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940480.982862:0:5847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940480.982871:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000133c7c80/0x27a633fcdd4ae05 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57b2 expref: 7 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.982882:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000133c7c80/0x27a633fcdd4ae05 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57b2 expref: 7 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940480.982923:0:5847:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000133c7c80/0x27a633fcdd4ae05 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57b2 expref: 7 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940480.982939:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b48a4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5847:1875839738252032:192.168.202.14@tcp:105: 00000100:00100000:1.0:1788940480.983266:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f194b3b180 going to sleep for 11 seconds 00000100:00100000:0.0:1788940480.988239:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940480.988403:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b48a4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5847:1875839738252032:192.168.202.14@tcp:105: 00010000:00010000:1.0:1788940480.988430:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940480.988500:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf583800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+7:2353:x1875839718289664:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 5790us (6020us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940480.988513:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 35 00000100:00100000:2.0:1788940480.990667:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718289920 00000100:00100000:2.0:1788940480.990682:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718289920 00000100:00100000:2.0:1788940480.990759:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 6 00000100:00100000:2.0:1788940480.990771:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf583b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+13:10297:x1875839718289920:12345-192.168.202.14@tcp:35:bash.0 00000100:00100000:2.0:1788940480.992759:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf583b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+14:10297:x1875839718289920:12345-192.168.202.14@tcp:35:bash.0 Request processed in 1981us (4523us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1788940480.992771:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 6 00000100:00100000:0.0:1788940481.117513:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940481.119567:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718290176 00000100:00100000:2.0:1788940481.119583:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718290176 00000100:00100000:2.0:1788940481.119661:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 41 00000100:00100000:2.0:1788940481.119671:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf582d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+14:10308:x1875839718290176:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:2.0:1788940481.119696:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940481.119725:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4ae0c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f57b9 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940481.119837:0:5860:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788940481.119960:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4ae0c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57b9 expref: 16 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940481.119974:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f1983af400) 00010000:00010000:2.0:1788940481.119978:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788940481.119984:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4ae0c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57b9 expref: 16 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940481.120000:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f188daac00, rc 0) 00000100:00100000:2.0:1788940481.120273:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf582d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+15:10308:x1875839718290176:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 601us (2770us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1788940481.120280:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 41 00000100:00100000:3.0:1788940481.131819:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940481.132136:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718290432 00000100:00100000:2.0:1788940481.132150:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718290432 00000100:00100000:2.0:1788940481.132222:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 7 00000100:00100000:2.0:1788940481.132233:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f191022a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+15:10308:x1875839718290432:12345-192.168.202.14@tcp:35:lfs.0 00000100:00100000:2.0:1788940481.132493:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f191022a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+16:10308:x1875839718290432:12345-192.168.202.14@tcp:35:lfs.0 Request processed in 260us (683us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1788940481.132501:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 7 00010000:00010000:3.0:1788940481.196970:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940481.280225:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940481.280825:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718290560 00000100:00100000:1.0:1788940481.280839:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718290560 00000100:00100000:1.0:1788940481.280916:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 42 00000100:00100000:1.0:1788940481.280929:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f191022300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+16:10314:x1875839718290560:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:1.0:1788940481.280957:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940481.280982:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4ae1a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f57c0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940481.281070:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4ae21 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940481.281084:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4ae21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940481.281094:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4ae21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940481.281127:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788940481.281131:0:5861:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788940481.281148:0:5861:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4ae21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940481.281172:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4ae1a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57c0 expref: 18 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940481.281191:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4ae21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57c0 expref: 17 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940481.281200:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89f188f81300) 00010000:00010000:1.0:1788940481.281213:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788940481.281232:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f19258c400, rc 0) 00000100:00100000:1.0:1788940481.281971:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f191022300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+17:10314:x1875839718290560:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 383us (1104us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940481.281984:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 42 00000100:00100000:0.0:1788940481.303471:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940481.303925:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718290816 00000100:00100000:2.0:1788940481.303940:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718290816 00000100:00100000:2.0:1788940481.304027:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 43 00000100:00100000:2.0:1788940481.304039:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf582a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+17:10314:x1875839718290816:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:2.0:1788940481.304066:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940481.304106:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4ae28 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f57c7 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940481.304206:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4ae2f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940481.304233:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4ae2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940481.304245:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4ae2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940481.304257:0:5860:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788940481.304424:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4ae28 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57c7 expref: 20 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940481.304448:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4ae2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57c7 expref: 19 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940481.304457:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89f186946800) 00010000:00010000:2.0:1788940481.304461:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788940481.304465:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f188dab600, rc 0) 00000100:00100000:2.0:1788940481.305121:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf582a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+19:10314:x1875839718290816:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 1082us (1659us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1788940481.305129:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 43 00000100:00100000:2.0:1788940481.315315:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940481.315365:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940481.315959:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718291200 00000100:00100000:1.0:1788940481.315972:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718291200 00000100:00100000:1.0:1788940481.316047:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 44 00000100:00100000:1.0:1788940481.316060:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f0821c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+19:10314:x1875839718291200:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:1.0:1788940481.316089:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940481.316112:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4ae3d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f57ce expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940481.316229:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4ae44 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940481.316246:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4ae44 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940481.316259:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4ae44 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940481.316272:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788940481.316742:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4ae3d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57ce expref: 22 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940481.317262:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4ae44 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57ce expref: 21 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940481.317273:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89f186946800) 00000100:00100000:3.0:1788940481.323327:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718290944 00000100:00100000:3.0:1788940481.323346:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718290944 00000100:00100000:3.0:1788940481.323432:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 2 00000100:00100000:3.0:1788940481.323444:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f0821c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+22:2353:x1875839718290944:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940481.323461:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940481.323489:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788940481.323495:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f19258d400, rc 0) 00000100:00100000:1.0:1788940481.323872:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f0821c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+22:10314:x1875839718291200:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 7814us (8505us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1788940481.323881:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 44 00010000:00010000:3.0:1788940481.346094:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4ae2f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57c7 expref: 21 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940481.346120:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89f186946800) 00010000:00010000:3.0:1788940481.346126:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940481.346205:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f0821c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+20:2353:x1875839718290944:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 22760us (30918us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940481.346215:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 2 00000100:00100000:0.0:1788940481.346656:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940481.354431:0:7074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718291328 00000100:00100000:3.0:1788940481.354449:0:7074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718291328 00000100:00100000:3.0:1788940481.356377:0:7074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 23 00000100:00100000:3.0:1788940481.356409:0:7074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf582300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+7:2352:x1875839718291328:12345-192.168.202.14@tcp:1:lfs.0 00010000:00010000:3.0:1788940481.356470:0:7074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051335490/0x27a633fcdd4ae52 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940481.356492:0:7074:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000133c7c80/0x27a633fcdd4ae05 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57b2 expref: 7 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940481.356566:0:7074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788940481.356570:0:7074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788940481.356575:0:7074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051335490/0x27a633fcdd4ae52 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940481.356616:0:7074:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000133c7c80/0x27a633fcdd4ae05 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57b2 expref: 7 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940481.356633:0:7074:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000133c7c80/0x27a633fcdd4ae05 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57b2 expref: 7 pid: 6708 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940481.356649:0:7074:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f191020e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7074:1875839738252160:192.168.202.14@tcp:104: 00000100:00100000:3.0:1788940481.356766:0:7074:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f191307900 going to sleep for 11 seconds 00000100:00100000:0.0:1788940481.371102:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940481.371209:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718291456 00000100:00100000:1.0:1788940481.371221:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718291456 00002000:00100000:1.0:1788940481.371379:0:6711:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff89f1bf580e00 x1875839718291456/t0(0) o4->9c51ff78-d02d-4e61-8a10-a2f8830f1679@192.168.202.14@tcp:457/0 lens 504/0 e 0 to 0 dl 1788940492 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788940481.371391:0:6711:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89f1bf580e00 with x1875839718291456 ext(0->12) 00010000:00010000:1.0:1788940481.371403:0:6711:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000133c7c80/0x27a633fcdd4ae05 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57b2 expref: 8 pid: 6708 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940481.371422:0:6711:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000133c7c80/0x27a633fcdd4ae05 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57b2 expref: 8 pid: 6708 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788940481.371430:0:6711:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff89f1bf580e00 00000100:00100000:1.0:1788940481.371559:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 0 00000100:00100000:1.0:1788940481.371572:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf580e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+8:2352:x1875839718291456:12345-192.168.202.14@tcp:4:lfs.0 00000100:00100000:3.0:1788940481.372852:0:7074:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f191020e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7074:1875839738252160:192.168.202.14@tcp:104: 00010000:00010000:3.0:1788940481.372879:0:7074:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000051335490/0x27a633fcdd4ae52 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940481.530043:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940481.530096:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940481.530248:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718291584 00000100:00100000:1.0:1788940481.530262:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718291584 00000100:00100000:1.0:1788940481.530328:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 297 00000100:00100000:1.0:1788940481.530341:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:2351:x1875839718291584:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788940481.530424:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:2351:x1875839718291584:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 87us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940481.530432:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 297 00000100:00100000:0.0:1788940481.531999:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718291712 00000100:00100000:0.0:1788940481.532011:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718291712 00000100:00100000:0.0:1788940481.532085:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 151 00000100:00100000:0.0:1788940481.532096:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f0821c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffa310cd-169f-42e3-8999-506116bada08+5:2351:x1875839718291712:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788940481.532173:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f0821c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffa310cd-169f-42e3-8999-506116bada08+5:2351:x1875839718291712:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 79us (2139us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940481.532192:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 151 00000100:00080000:2.0:1788940481.533306:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:2.0:1788940481.541038:0:7662:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9c51ff78-d02d-4e61-8a10-a2f8830f1679 00000100:00100000:1.0:1788940481.541777:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf580e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+9:2352:x1875839718291456:12345-192.168.202.14@tcp:4:lfs.0 Request processed in 170201us (170679us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788940481.542076:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 0 00002000:00100000:1.0:1788940481.542092:0:6711:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff89f1bf580e00 x1875839718291456/t4294967299(0) o4->9c51ff78-d02d-4e61-8a10-a2f8830f1679@192.168.202.14@tcp:457/0 lens 504/448 e 0 to 0 dl 1788940492 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788940481.542103:0:6711:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89f1bf580e00 with x1875839718291456 ext(0->12) 00010000:00010000:1.0:1788940481.542115:0:6711:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000133c7c80/0x27a633fcdd4ae05 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57b2 expref: 9 pid: 6708 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940481.542138:0:6711:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000133c7c80/0x27a633fcdd4ae05 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57b2 expref: 9 pid: 6708 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788940481.542146:0:6711:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff89f1bf580e00 00000100:00100000:3.0:1788940481.548168:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940481.548329:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718291840 00000100:00100000:0.0:1788940481.548342:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718291840 00010000:00010000:0.0:1788940481.548388:0:8470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000133c7c80/0x27a633fcdd4ae05 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57b2 expref: 9 pid: 6708 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940481.548438:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 36 00000100:00100000:0.0:1788940481.548449:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f191020e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+9:2353:x1875839718291840:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940481.548469:0:8470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788940481.548488:0:8470:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788940481.548492:0:8470:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788940482 00002000:00010000:0.0:1788940481.548494:0:8470:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788940482 00002000:00010000:0.0:1788940481.548495:0:8470:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788940482 00010000:00010000:0.0:1788940481.548501:0:8470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000133c7c80/0x27a633fcdd4ae05 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57b2 expref: 9 pid: 6708 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940481.548553:0:8470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000133c7c80/0x27a633fcdd4ae05 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57b2 expref: 9 pid: 6708 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940481.548580:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000133c7c80/0x27a633fcdd4ae05 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57b2 expref: 9 pid: 6708 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940481.548597:0:8470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788940481.548601:0:8470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788940481.548607:0:8470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000051335490/0x27a633fcdd4ae52 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940481.548639:0:8470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051335490/0x27a633fcdd4ae52 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940481.548673:0:8470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788940481.548811:0:7074:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000051335490/0x27a633fcdd4ae52 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940481.548821:0:7074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051335490/0x27a633fcdd4ae52 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940481.548856:0:7074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051335490/0x27a633fcdd4ae52 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940481.548865:0:7074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000051335490/0x27a633fcdd4ae52 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940481.548873:0:7074:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000051335490/0x27a633fcdd4ae52 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940481.548881:0:7074:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f180031a00 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:3.0:1788940481.548885:0:7074:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000051335490/0x27a633fcdd4ae52 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940481.548894:0:7074:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000051335490/0x27a633fcdd4ae52 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940481.548908:0:7074:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000051335490/0x27a633fcdd4ae52 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940481.548915:0:7074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051335490/0x27a633fcdd4ae52 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940481.548981:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f191020e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+8:2353:x1875839718291840:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 532us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940481.549000:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 36 00000100:00100000:3.0:1788940481.549383:0:7074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf582300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+7:2352:x1875839718291328:12345-192.168.202.14@tcp:1:lfs.0 Request processed in 192989us (202727us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940481.549393:0:7074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 23 00000100:00100000:2.0:1788940481.556733:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940481.556852:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718292096 00000100:00100000:1.0:1788940481.556865:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718292096 00000100:00100000:1.0:1788940481.556968:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 8 00000100:00100000:1.0:1788940481.556980:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf554e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+20:10314:x1875839718292096:12345-192.168.202.14@tcp:35:lfs.0 00000004:00010000:1.0:1788940481.557066:0:5864:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4ae44 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57ce expref: 20 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788940481.557381:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:1.0:1788940481.557440:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:1.0:1788940481.557989:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:1.0:1788940481.558051:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4ae59 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940481.558068:0:5864:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4ade9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57a4 expref: 24 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940481.558085:0:5864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4ae59 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940481.558124:0:5864:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4ade9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57a4 expref: 24 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940481.558139:0:5864:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4ade9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57a4 expref: 24 pid: 7857 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940481.558155:0:5864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b48a4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5864:1875839738252288:192.168.202.14@tcp:104: 00000100:00100000:1.0:1788940481.558270:0:5864:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1b0ca0b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788940481.568961:0:5864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b48a4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5864:1875839738252288:192.168.202.14@tcp:104: 00010000:00010000:1.0:1788940481.569010:0:5864:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4ae59 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940481.570316:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940481.570395:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718292224 00000100:00100000:0.0:1788940481.570407:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718292224 00010000:00010000:0.0:1788940481.570456:0:5845:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4ade9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57a4 expref: 25 pid: 7857 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940481.570498:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 37 00000100:00100000:0.0:1788940481.570515:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf554380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+25:2352:x1875839718292224:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940481.570559:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940481.570565:0:5845:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4ade9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57a4 expref: 25 pid: 7857 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940481.570589:0:5845:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4ade9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57a4 expref: 25 pid: 7857 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940481.570614:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4ade9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57a4 expref: 25 pid: 7857 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940481.570633:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89f186946800) 00010000:00010000:0.0:1788940481.570656:0:5845:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4ae59 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940481.570667:0:5845:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4ae59 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940481.570675:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4ae59 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940481.571943:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940481.572034:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf554380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+24:2352:x1875839718292224:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 1517us (1720us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940481.572045:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 37 00010000:00010000:1.0:1788940481.572121:0:5864:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4ae59 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940481.572131:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4ae59 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788940481.572265:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1788940481.572493:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:1.0:1788940481.572704:0:5864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b48a4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5864:1875839738252416:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788940481.573158:0:5864:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940481.573196:0:5864:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1b0ca0c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788940481.573236:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738252416 00000100:00100000:1.0:1788940481.573249:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738252416 00000100:00100000:1.0:1788940481.573692:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788940481.573703:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b48a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5864:x1875839738252416:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788940481.573862:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b48a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5864:x1875839738252416:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 160us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940481.573870:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788940481.573912:0:5864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b48a4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5864:1875839738252416:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788940481.575160:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:1.0:1788940481.575264:0:5864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b48a4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5864:1875839738252544:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788940481.575882:0:5864:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940481.575955:0:5864:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1b0ca0b40 going to sleep for 11 seconds 00000100:00080000:3.0:1788940481.581410:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788940481.583881:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738252544 00000100:00100000:0.0:1788940481.583898:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738252544 00000100:00100000:0.0:1788940481.584033:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788940481.584045:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1aed97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5864:x1875839738252544:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788940481.584360:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1aed97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5864:x1875839738252544:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 317us (8477us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788940481.584368:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788940481.584457:0:5864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b48a4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5864:1875839738252544:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788940481.584557:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:1.0:1788940481.584612:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4ae59 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940481.584623:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4ae59 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940481.584630:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4ae59 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940481.584635:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258d800 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940481.584640:0:5864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4ae59 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940481.584647:0:5864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4ae59 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940481.584678:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89f186946800) 00010000:00010000:1.0:1788940481.584680:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788940481.584685:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4ae59 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940481.584690:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4ae59 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788940481.584897:0:5864:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788940481.585123:0:5864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1788940481.585134:0:5864:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 424483615390ns, next at 425483613314ns, rc = 0 00000001:00080000:1.0:1788940481.585142:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:1.0:1788940481.585171:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89f186946800) 00010000:00010000:1.0:1788940481.585175:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788940481.585182:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4ae44 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57ce expref: 28 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940481.585298:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf554e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+27:10314:x1875839718292096:12345-192.168.202.14@tcp:35:lfs.0 Request processed in 28320us (28580us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1788940481.585307:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 8 00000020:00080000:1.0:1788940481.585311:0:5864:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788940481.600816:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940481.600908:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718292352 00000100:00100000:1.0:1788940481.600921:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718292352 00000100:00100000:1.0:1788940481.600992:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 45 00000100:00100000:1.0:1788940481.601005:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf554a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+27:10314:x1875839718292352:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:1.0:1788940481.601033:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940481.601058:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4ae60 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f57d5 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940481.601140:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4ae60 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57d5 expref: 28 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940481.601156:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4ae60 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57d5 expref: 28 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940481.601176:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89f188f81b00) 00010000:00010000:1.0:1788940481.601179:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788940481.601183:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f19258d000, rc 0) 00000100:00100000:1.0:1788940481.601256:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf554a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+28:10314:x1875839718292352:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 253us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940481.601263:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 45 00000100:00100000:2.0:1788940481.605861:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940481.605944:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718292608 00000100:00100000:1.0:1788940481.605956:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718292608 00000100:00100000:1.0:1788940481.606026:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 9 00000100:00100000:1.0:1788940481.606039:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b0613050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+28:10314:x1875839718292608:12345-192.168.202.14@tcp:35:lfs.0 00000100:00100000:1.0:1788940481.606303:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b0613050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+29:10314:x1875839718292608:12345-192.168.202.14@tcp:35:lfs.0 Request processed in 266us (450us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1788940481.606320:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 9 00000100:00100000:1.0:1788940481.799097:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940481.799743:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718292864 00000100:00100000:0.0:1788940481.799767:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718292864 00000100:00100000:0.0:1788940481.799839:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 46 00000100:00100000:0.0:1788940481.799851:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1aed94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+29:10324:x1875839718292864:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:0.0:1788940481.799877:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940481.799900:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4ae67 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f57dc expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940481.800406:0:5860:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788940481.800728:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4ae67 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57dc expref: 31 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940481.800746:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f1983af400) 00010000:00010000:0.0:1788940481.800831:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788940481.800840:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4ae67 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57dc expref: 31 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940481.800857:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f082ad3800, rc 0) 00000100:00100000:0.0:1788940481.800935:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1aed94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+30:10324:x1875839718292864:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 1086us (1847us total) trans 4294967327 rc 301/301 00000100:00100000:0.0:1788940481.800943:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 46 00000100:00100000:3.0:1788940481.808699:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940481.808974:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718292992 00000100:00100000:1.0:1788940481.809264:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718292992 00000100:00100000:1.0:1788940481.809561:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 47 00000100:00100000:1.0:1788940481.809583:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f191022680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+30:10324:x1875839718292992:12345-192.168.202.14@tcp:34:lfs.0 00010000:00010000:1.0:1788940481.809667:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4ae75 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940481.809696:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4ae75 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940481.809709:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4ae75 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940481.809725:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4ae7c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940481.809733:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4ae7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940481.809740:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4ae7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940481.809842:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4ae83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940481.809851:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4ae83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940481.809858:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4ae83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788940481.809901:0:5861:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4ae83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940481.809915:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4ae75 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940481.809921:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4ae75 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940481.809939:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4ae75 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940481.809945:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258d400 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940481.809949:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4ae75 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940481.809958:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4ae75 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940481.809971:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89f188f81300) 00010000:00010000:1.0:1788940481.809975:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940481.809981:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4ae75 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940481.810001:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4ae75 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940481.810016:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4ae7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940481.810022:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4ae7c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940481.810028:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4ae7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940481.810033:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258d800 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940481.810036:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4ae7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940481.810051:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4ae7c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940481.810059:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff89f188f81600) 00010000:00010000:1.0:1788940481.810062:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940481.810065:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4ae7c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940481.810071:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4ae7c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940481.810088:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4ae83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940481.810094:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4ae83 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940481.810100:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4ae83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940481.810104:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258c000 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940481.810107:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4ae83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940481.810112:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4ae83 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940481.810118:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89f188f81b00) 00010000:00010000:1.0:1788940481.810120:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940481.810123:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4ae83 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940481.810139:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4ae83 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940481.810253:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f191022680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+30:10324:x1875839718292992:12345-192.168.202.14@tcp:34:lfs.0 Request processed in 672us (1684us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940481.810261:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 47 00000100:00100000:2.0:1788940481.813875:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940481.813960:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718293248 00000100:00100000:1.0:1788940481.813973:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718293248 00000100:00100000:1.0:1788940481.814894:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 10 00000100:00100000:1.0:1788940481.814911:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf554000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+30:10324:x1875839718293248:12345-192.168.202.14@tcp:35:lfs.0 00000100:00100000:1.0:1788940481.817905:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf554000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+31:10324:x1875839718293248:12345-192.168.202.14@tcp:35:lfs.0 Request processed in 2989us (4029us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1788940481.817919:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 10 00000040:00080000:1.0:1788940481.838107:0:11708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788940481.969683:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940481.969906:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718293504 00000100:00100000:2.0:1788940481.969921:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718293504 00000100:00100000:2.0:1788940481.970006:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 48 00000100:00100000:2.0:1788940481.970017:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf582680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+31:10327:x1875839718293504:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:2.0:1788940481.970046:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940481.970068:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa800/0x27a633fcdd4ae8a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f57e3 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940481.970163:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4ae91 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940481.970181:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4ae91 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940481.970194:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4ae91 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940481.970212:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4ae98 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940481.970243:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4ae98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940481.970250:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4ae98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940481.974580:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daae00/0x27a633fcdd4ae9f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940481.974602:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daae00/0x27a633fcdd4ae9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940481.974615:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daae00/0x27a633fcdd4ae9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940481.974628:0:5860:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788940481.974736:0:5860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4ae91 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940481.974744:0:5860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4ae91 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940481.974751:0:5860:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4ae91 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940481.974757:0:5860:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188daa600 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940481.974761:0:5860:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4ae91 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940481.974769:0:5860:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4ae91 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940481.974801:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89f188f81300) 00010000:00010000:2.0:1788940481.974803:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940481.974809:0:5860:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4ae91 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940481.974816:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4ae91 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940481.974832:0:5860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4ae98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940481.974839:0:5860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4ae98 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940481.974844:0:5860:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4ae98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940481.974849:0:5860:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188daa400 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940481.974852:0:5860:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4ae98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940481.974857:0:5860:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4ae98 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940481.974865:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff89f186946500) 00010000:00010000:2.0:1788940481.974868:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940481.974871:0:5860:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4ae98 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940481.974876:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4ae98 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940481.974967:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa800/0x27a633fcdd4ae8a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57e3 expref: 34 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940481.974981:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daae00/0x27a633fcdd4ae9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57e3 expref: 33 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940481.974988:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89f188f81b00) 00010000:00010000:2.0:1788940481.974990:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788940481.974993:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f188daae00, rc 0) 00000100:00100000:2.0:1788940481.975065:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf582680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+33:10327:x1875839718293504:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 5050us (5394us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1788940481.975075:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 48 00000100:00100000:3.0:1788940481.986619:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940481.986926:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718293632 00000100:00100000:2.0:1788940481.986949:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718293632 00000100:00100000:2.0:1788940481.987090:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 49 00000100:00100000:2.0:1788940481.987104:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f191020380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+33:10327:x1875839718293632:12345-192.168.202.14@tcp:54:lfs.0 00010000:00010000:2.0:1788940481.987197:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa800/0x27a633fcdd4aead lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940481.987217:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa800/0x27a633fcdd4aead lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940481.987230:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa800/0x27a633fcdd4aead lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940481.987262:0:7857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa800/0x27a633fcdd4aead lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940481.987302:0:7857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa800/0x27a633fcdd4aead lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940481.987309:0:7857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa800/0x27a633fcdd4aead lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940481.987316:0:7857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188daa800 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940481.987320:0:7857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa800/0x27a633fcdd4aead lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940481.987329:0:7857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa800/0x27a633fcdd4aead lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940481.987341:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89f188f81b00) 00010000:00010000:2.0:1788940481.987345:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788940481.987350:0:7857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa800/0x27a633fcdd4aead lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940481.987357:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa800/0x27a633fcdd4aead lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940481.987445:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f191020380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+33:10327:x1875839718293632:12345-192.168.202.14@tcp:54:lfs.0 Request processed in 343us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940481.987453:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 49 00000100:00100000:3.0:1788940482.002090:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940482.002189:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718293888 00000100:00100000:0.0:1788940482.002203:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718293888 00000100:00100000:0.0:1788940482.002340:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 11 00000100:00100000:0.0:1788940482.002354:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f191021180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+33:10327:x1875839718293888:12345-192.168.202.14@tcp:35:lfs.0 00000100:00100000:0.0:1788940482.002669:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f191021180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+34:10327:x1875839718293888:12345-192.168.202.14@tcp:35:lfs.0 Request processed in 317us (590us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1788940482.002678:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 11 00000100:00080000:3.0:1788940482.005459:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940482.028908:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1aed97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875839738252800:0@lo:400:kworker.0 00000100:00100000:2.0:1788940482.028977:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940482.029050:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788940482.029056:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1aed95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875839738252928:0@lo:400:kworker.0 00000100:00100000:2.0:1788940482.029075:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940482.029125:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738252800 00000100:00100000:2.0:1788940482.029135:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738252800 00000100:00100000:2.0:1788940482.029185:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738252928 00000100:00100000:2.0:1788940482.029188:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738252928 00000100:00100000:2.0:1788940482.029215:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788940482.029224:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf554700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875839738252800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940482.029272:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf554700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875839738252800:12345-0@lo:400:kworker.0 Request processed in 50us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940482.029279:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788940482.029295:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788940482.029300:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf555500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875839738252928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940482.029321:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf555500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875839738252928:12345-0@lo:400:kworker.0 Request processed in 21us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940482.029327:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788940482.029362:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1aed95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875839738252928:0@lo:400:kworker.0 00000100:00100000:2.0:1788940482.029370:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1aed97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875839738252800:0@lo:400:kworker.0 00000100:00100000:0.0:1788940482.029472:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1aed94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738253056:0@lo:400:kworker.0 00000100:00100000:0.0:1788940482.029509:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940482.029584:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788940482.029591:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1aed95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3305:1875839738252672:0@lo:400:kworker.0 00000100:00100000:0.0:1788940482.029620:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940482.029642:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae7c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875839738253184:0@lo:400:kworker.0 00000100:00100000:0.0:1788940482.029662:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940482.029687:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738252672 00000100:00100000:0.0:1788940482.029691:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738252672 00000100:00100000:0.0:1788940482.029733:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1788940482.029741:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3305:x1875839738252672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940482.029787:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3305:x1875839738252672:12345-0@lo:400:kworker.0 Request processed in 46us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940482.029793:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1788940482.029829:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1aed95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3305:1875839738252672:0@lo:400:kworker.0 00000100:00100000:0.0:1788940482.029846:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738253184 00000100:00100000:0.0:1788940482.029849:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738253184 00000100:00100000:0.0:1788940482.029886:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788940482.029895:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf581180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875839738253184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940482.029929:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf581180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875839738253184:12345-0@lo:400:kworker.0 Request processed in 36us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940482.029935:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788940482.029957:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae7c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875839738253184:0@lo:400:kworker.0 00000100:00100000:2.0:1788940482.030563:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738253056 00000100:00100000:2.0:1788940482.030570:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738253056 00000100:00100000:2.0:1788940482.030613:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788940482.030621:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf580380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738253056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940482.030669:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf580380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738253056:12345-0@lo:400:kworker.0 Request processed in 50us (1160us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940482.030675:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788940482.032362:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1aed94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738253056:0@lo:400:kworker.0 00000100:00080000:3.0:1788940482.034040:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788940482.034052:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940482.036514:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788940482.036589:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae7caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738253312:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788940482.036662:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940482.036714:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738253312 00000100:00100000:1.0:1788940482.036724:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738253312 00000100:00100000:1.0:1788940482.036794:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788940482.036805:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae7c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738253312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788940482.036844:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788940482.036889:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae7c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738253312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940482.036897:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788940482.036965:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae7caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738253312:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1788940482.149601:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967330 is committed 00000004:00080000:3.0:1788940482.149634:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:3.0:1788940482.149666:0:5883:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89f1b0ca0c00 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1788940482.149671:0:5883:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89f1ae636d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89f1b0ca0300 00000020:00080000:3.0:1788940482.149675:0:5883:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89f1ae636100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89f1bfaa1800 00000020:00080000:3.0:1788940482.149727:0:5894:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1788940482.149899:0:5894:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1788940482.150384:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788940482.150404:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf581500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738253440:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788940482.150509:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940482.150621:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738253440 00000100:00100000:0.0:1788940482.150630:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738253440 00000100:00100000:0.0:1788940482.150685:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788940482.150697:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf580700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1875839738253440:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788940482.150726:0:6705:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:0.0:1788940482.150770:0:6705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6aa110c2, atime: 0x6aa110c2, ctime: 0x6aa110c2, blocks: 0x1 00010000:00010000:0.0:1788940482.150779:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de6a393f/0x27a633fcdd4aeb4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940482.150807:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=425s v=(0 0) 00010000:00010000:0.0:1788940482.150813:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940482.150820:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de6a393f/0x27a633fcdd4aeb4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940482.150838:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de6a393f/0x27a633fcdd4aeb4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940482.150849:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de6a393f/0x27a633fcdd4aeb4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940482.150857:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000de6a393f/0x27a633fcdd4aeb4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940482.150874:0:6705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788940482.151375:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf580700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3307:x1875839738253440:12345-0@lo:6:osp-syn-1-0.0 Request processed in 679us (865us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788940482.151383:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1788940482.151411:0:7650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940482.151418:0:7650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000de6a393f/0x27a633fcdd4aeb4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940482.151426:0:7650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad3200 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:0.0:1788940482.151430:0:7650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000de6a393f/0x27a633fcdd4aeb4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940482.151452:0:7650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000de6a393f/0x27a633fcdd4aeb4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940482.151468:0:7650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000de6a393f/0x27a633fcdd4aeb4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940482.151474:0:7650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de6a393f/0x27a633fcdd4aeb4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940482.151495:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940482.151497:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940482.151498:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788940482.151585:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89f1bf581500/2, rc 0, transno 4294967301 00000100:00100000:0.0:1788940482.151591:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf581500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738253440:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788940482.221209:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940482.697069:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940482.697183:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718294144 00000100:00100000:2.0:1788940482.697196:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718294144 00000100:00100000:2.0:1788940482.697276:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 50 00000100:00100000:2.0:1788940482.697289:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf583480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+12:10358:x1875839718294144:12345-192.168.202.14@tcp:101:cat.0 00010000:00010000:2.0:1788940482.697337:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940482.697363:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa800/0x27a633fcdd4aebb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f57ea expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940482.697472:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4aec2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940482.697488:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4aec2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940482.697500:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4aec2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940482.697554:0:5860:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788940482.697966:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa800/0x27a633fcdd4aebb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57ea expref: 15 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940482.697986:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4aec2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57ea expref: 14 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940482.697996:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89f188f81b00) 00010000:00010000:2.0:1788940482.698000:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788940482.698004:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f188daa400, rc 0) 00000100:00100000:2.0:1788940482.698147:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf583480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+14:10358:x1875839718294144:12345-192.168.202.14@tcp:101:cat.0 Request processed in 861us (1086us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1788940482.698156:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 50 00000100:00100000:1.0:1788940482.731012:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940482.740988:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718294400 00000100:00100000:0.0:1788940482.741017:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718294400 00000100:00100000:0.0:1788940482.741107:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 12 00000100:00100000:0.0:1788940482.741119:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae7caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+14:10358:x1875839718294400:12345-192.168.202.14@tcp:35:cat.0 00000100:00100000:0.0:1788940482.741418:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae7caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+15:10358:x1875839718294400:12345-192.168.202.14@tcp:35:cat.0 Request processed in 300us (10425us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1788940482.741427:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 12 00000100:00100000:3.0:1788940482.741918:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940482.742116:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718294528 00000100:00100000:2.0:1788940482.742124:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718294528 00000100:00100000:2.0:1788940482.742172:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 3 00000100:00100000:2.0:1788940482.742198:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1841b7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+15:2353:x1875839718294528:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788940482.742210:0:8470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940482.742235:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4aec2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57ea expref: 15 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940482.742255:0:8470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89f188f81b00) 00010000:00010000:2.0:1788940482.742260:0:8470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940482.742291:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1841b7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+14:2353:x1875839718294528:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 96us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940482.742298:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 3 00000100:00100000:3.0:1788940482.883613:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940482.889567:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718294784 00000100:00100000:1.0:1788940482.889584:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718294784 00000100:00100000:1.0:1788940482.889656:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 51 00000100:00100000:1.0:1788940482.889665:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f191021500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+14:10364:x1875839718294784:12345-192.168.202.14@tcp:101:dd.0 00010000:00010000:1.0:1788940482.889689:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940482.889691:0:5862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788940482.889714:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4ae21 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57c0 expref: 14 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940482.889730:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89f188f81300) 00010000:00010000:1.0:1788940482.889734:0:5862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788940482.889745:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4aed0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f57f1 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940482.889836:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4aed7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940482.889846:0:5862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daae00/0x27a633fcdd4ae9f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57e3 expref: 14 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940482.889852:0:5862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4aed7 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940482.889880:0:5862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daae00/0x27a633fcdd4ae9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57e3 expref: 14 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940482.889891:0:5862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daae00/0x27a633fcdd4ae9f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57e3 expref: 14 pid: 5860 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940482.889918:0:5862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae7cad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5862:1875839738253568:192.168.202.14@tcp:104: 00000100:00100000:1.0:1788940482.891116:0:5862:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f184173540 going to sleep for 11 seconds 00000100:00100000:1.0:1788940482.894624:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940482.894664:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718294912 00000100:00100000:1.0:1788940482.894675:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718294912 00010000:00010000:1.0:1788940482.894723:0:5845:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daae00/0x27a633fcdd4ae9f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57e3 expref: 15 pid: 5860 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940482.894771:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 38 00000100:00100000:1.0:1788940482.894781:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae7c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+15:2352:x1875839718294912:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788940482.894798:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940482.894805:0:5845:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daae00/0x27a633fcdd4ae9f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57e3 expref: 15 pid: 5860 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940482.894818:0:5845:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daae00/0x27a633fcdd4ae9f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57e3 expref: 15 pid: 5860 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940482.894841:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89f188f81b00) 00010000:00010000:1.0:1788940482.894846:0:5845:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4aed7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940482.894855:0:5845:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4aed7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940482.894863:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4aed7 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940482.894903:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940482.895166:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae7c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+15:2352:x1875839718294912:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 384us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940482.895175:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 38 00010000:00010000:3.0:1788940482.895539:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daae00/0x27a633fcdd4ae9f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57e3 expref: 14 pid: 5860 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940482.895558:0:5862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae7cad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5862:1875839738253568:192.168.202.14@tcp:104: 00010000:00010000:3.0:1788940482.895580:0:5862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4aed7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940482.895586:0:5862:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4aed7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940482.895591:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4aed7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940482.895615:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788940482.895771:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4aed0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57f1 expref: 15 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940482.895784:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4aed7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57f1 expref: 14 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940482.895789:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89f188f81b00) 00010000:00010000:3.0:1788940482.895791:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788940482.895793:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f19258dc00, rc 0) 00000100:00100000:3.0:1788940482.895828:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f191021500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+14:10364:x1875839718294784:12345-192.168.202.14@tcp:101:dd.0 Request processed in 6165us (12225us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1788940482.895833:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 51 00000100:00100000:2.0:1788940482.908683:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940482.908824:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718295168 00000100:00100000:0.0:1788940482.908836:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718295168 00000100:00100000:0.0:1788940482.908893:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 52 00000100:00100000:0.0:1788940482.908921:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf554380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+14:10364:x1875839718295168:12345-192.168.202.14@tcp:36:dd.0 00010000:00010000:0.0:1788940482.909217:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3200/0x27a633fcdd4aee5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940482.909233:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3200/0x27a633fcdd4aee5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940482.909242:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3200/0x27a633fcdd4aee5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788940482.909290:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:0.0:1788940482.909317:0:5860:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000059b0553 reply state 0000000064d462ff transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3200/0x27a633fcdd4aee5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940482.909325:0:5860:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788940482.909412:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf554380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+17:10364:x1875839718295168:12345-192.168.202.14@tcp:36:dd.0 Request processed in 494us (740us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1788940482.909417:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 52 00000020:00080000:0.0:1788940482.909421:0:5860:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788940482.911572:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3200/0x27a633fcdd4aee5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940482.911590:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3200/0x27a633fcdd4aee5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940482.911597:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3200/0x27a633fcdd4aee5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940482.911603:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad3200 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940482.911607:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3200/0x27a633fcdd4aee5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940482.911615:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3200/0x27a633fcdd4aee5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940482.911654:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89f188f81b00) 00010000:00010000:3.0:1788940482.911657:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940482.911663:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3200/0x27a633fcdd4aee5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940482.911669:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3200/0x27a633fcdd4aee5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940483.246513:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940483.339934:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940483.340079:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718295296 00000100:00100000:2.0:1788940483.340093:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718295296 00000100:00100000:2.0:1788940483.340172:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 53 00000100:00100000:2.0:1788940483.340186:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae7cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+16:10378:x1875839718295296:12345-192.168.202.14@tcp:101:stat.0 00010000:00010000:2.0:1788940483.340216:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940483.340239:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4aeec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f57f8 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940483.340320:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4aef3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940483.340338:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4aef3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940483.340353:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4aef3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940483.340389:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4aefa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940483.340397:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4aefa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940483.340403:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4aefa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940483.340952:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4af01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940483.341224:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4aed7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57f1 expref: 17 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940483.341234:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4af01 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940483.341419:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4aed7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57f1 expref: 17 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940483.341438:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4aed7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57f1 expref: 17 pid: 5862 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940483.341453:0:5861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf554e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5861:1875839738253696:192.168.202.14@tcp:104: 00000100:00100000:2.0:1788940483.341827:0:5861:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1bf5b4840 going to sleep for 11 seconds 00000100:00100000:2.0:1788940483.347101:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940483.347248:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718295552 00000100:00100000:0.0:1788940483.347273:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718295552 00000100:00100000:0.0:1788940483.347345:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 13 00000100:00100000:0.0:1788940483.347366:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae81d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+18:5596:x1875839718295552:12345-192.168.202.14@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788940483.347880:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae81d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+19:5596:x1875839718295552:12345-192.168.202.14@tcp:35:ldlm_bl.0 Request processed in 522us (784us total) trans 4294967336 rc 0/0 00000100:00100000:0.0:1788940483.347890:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 13 00000100:00100000:1.0:1788940483.349612:0:5861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf554e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5861:1875839738253696:192.168.202.14@tcp:104: 00010000:00010000:1.0:1788940483.349648:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4af01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940483.353769:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940483.353878:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718295680 00000100:00100000:2.0:1788940483.353889:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718295680 00010000:00010000:2.0:1788940483.353952:0:8470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4aed7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57f1 expref: 19 pid: 5862 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940483.354001:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 39 00000100:00100000:2.0:1788940483.354013:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f191020700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+19:2352:x1875839718295680:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788940483.354029:0:8470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940483.354036:0:8470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4aed7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57f1 expref: 19 pid: 5862 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940483.354051:0:8470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4aed7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57f1 expref: 19 pid: 5862 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940483.354073:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4aed7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57f1 expref: 19 pid: 5862 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940483.354091:0:8470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89f188f81b00) 00010000:00010000:2.0:1788940483.354097:0:8470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4af01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940483.354105:0:8470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4af01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940483.354114:0:8470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4af01 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940483.354149:0:8470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940483.354219:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f191020700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+18:2352:x1875839718295680:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 208us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940483.354227:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 39 00010000:00010000:1.0:1788940483.354378:0:5861:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4af01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940483.354387:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4af01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940483.354444:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788940483.354448:0:5861:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788940483.354491:0:5861:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4af01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940483.354513:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4af01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940483.354555:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4aef3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940483.354562:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4aef3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940483.354569:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4aef3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940483.354583:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188dab800 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940483.354588:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4aef3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940483.354596:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4aef3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940483.354606:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89f188f81300) 00010000:00010000:1.0:1788940483.354609:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940483.354613:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4aef3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940483.354619:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4aef3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940483.354632:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4aefa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940483.354638:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4aefa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940483.354643:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4aefa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940483.354648:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188daaa00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940483.354650:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4aefa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940483.354656:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4aefa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940483.354675:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff89f186946500) 00010000:00010000:1.0:1788940483.354677:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940483.354680:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4aefa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940483.354685:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4aefa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940483.354725:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4aeec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57f8 expref: 18 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940483.354740:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4af01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57f8 expref: 17 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940483.354748:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89f188f81b00) 00010000:00010000:1.0:1788940483.354750:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788940483.354752:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f188dabe00, rc 0) 00000100:00100000:1.0:1788940483.354783:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae7cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+17:10378:x1875839718295296:12345-192.168.202.14@tcp:101:stat.0 Request processed in 14601us (14859us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940483.354791:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 53 00000100:00100000:0.0:1788940483.564839:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf554e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738253824:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788940483.564922:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940483.565537:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738253824 00000100:00100000:1.0:1788940483.565549:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738253824 00000100:00100000:1.0:1788940483.565630:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788940483.565641:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf581f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1875839738253824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788940483.565681:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788940483.565746:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf581f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1875839738253824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940483.565766:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788940483.566214:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf554e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738253824:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788940483.566708:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788940483.571166:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940483.571329:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718295936 00000100:00100000:2.0:1788940483.571342:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718295936 00000100:00100000:2.0:1788940483.571425:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 54 00000100:00100000:2.0:1788940483.571437:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f191020e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+17:10384:x1875839718295936:12345-192.168.202.14@tcp:36:truncate.0 00010000:00010000:2.0:1788940483.571549:0:7857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940483.571584:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4af01 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57f8 expref: 17 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940483.571605:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89f188f81b00) 00010000:00010000:2.0:1788940483.571611:0:7857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788940483.571823:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4af08 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940483.571837:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4af08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940483.571848:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4af08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788940483.571900:0:7857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:2.0:1788940483.571926:0:7857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a680610d reply state 0000000026e62fa3 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4af08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940483.571936:0:7857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788940483.572268:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f191020e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+19:10384:x1875839718295936:12345-192.168.202.14@tcp:36:truncate.0 Request processed in 831us (1111us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1788940483.572276:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 54 00000020:00080000:2.0:1788940483.572281:0:7857:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788940483.578746:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4af08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940483.578769:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4af08 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940483.578778:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4af08 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940483.578785:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188daa600 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940483.578791:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4af08 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940483.578800:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4af08 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940483.578823:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89f188f81b00) 00010000:00010000:1.0:1788940483.578827:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940483.578833:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4af08 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940483.578841:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4af08 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940483.786892:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940483.787021:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718296064 00000100:00100000:1.0:1788940483.787032:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718296064 00000100:00100000:1.0:1788940483.787099:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 55 00000100:00100000:1.0:1788940483.787117:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f191022a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+18:10398:x1875839718296064:12345-192.168.202.14@tcp:101:stat.0 00010000:00010000:1.0:1788940483.787145:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940483.787179:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4af0f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f57ff expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940483.787245:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4af16 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940483.787260:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4af16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940483.787272:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4af16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940483.787286:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4af1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940483.787293:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4af1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940483.787300:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4af1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940483.787598:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4af24 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940483.787607:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4af24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940483.787614:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4af24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940483.787650:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1788940483.787655:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788940483.787673:0:5862:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4af24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940483.787689:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4af24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940483.787698:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4af16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940483.787704:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4af16 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940483.787711:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4af16 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940483.787717:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258c600 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940483.787721:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4af16 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940483.787729:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4af16 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940483.787739:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89f188f81300) 00010000:00010000:1.0:1788940483.787742:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940483.787747:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4af16 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940483.787753:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4af16 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940483.787764:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4af1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940483.787770:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4af1d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940483.787783:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4af1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940483.787788:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258dc00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940483.787791:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4af1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940483.787797:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4af1d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940483.787804:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff89f188f81600) 00010000:00010000:1.0:1788940483.787806:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940483.787808:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4af1d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940483.787813:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4af1d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940483.787842:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4af0f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57ff expref: 20 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940483.787854:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4af24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57ff expref: 19 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940483.787861:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89f188f81b00) 00010000:00010000:1.0:1788940483.787863:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788940483.787865:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f19258c200, rc 0) 00000100:00100000:1.0:1788940483.787932:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f191022a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+19:10398:x1875839718296064:12345-192.168.202.14@tcp:101:stat.0 Request processed in 823us (1049us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940483.787946:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 55 00000100:00100000:0.0:1788940483.870128:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940483.873744:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718296320 00000100:00100000:2.0:1788940483.873763:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718296320 00000100:00100000:2.0:1788940483.873891:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 56 00000100:00100000:2.0:1788940483.873904:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf581880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+19:10407:x1875839718296320:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:2.0:1788940483.873929:0:7857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940483.873954:0:7857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4af2b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5806 expref: -99 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940483.874077:0:7857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788940483.874250:0:7857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4af2b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5806 expref: 21 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940483.874268:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f1983af400) 00010000:00010000:2.0:1788940483.874272:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788940483.874279:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4af2b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5806 expref: 21 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940483.874299:0:7857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f188dabe00, rc 0) 00000100:00100000:2.0:1788940483.874387:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf581880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+20:10407:x1875839718296320:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 486us (4284us total) trans 4294967339 rc 301/301 00000100:00100000:2.0:1788940483.874395:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 56 00000100:00100000:3.0:1788940483.897285:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940483.898703:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718296576 00000100:00100000:0.0:1788940483.898723:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718296576 00000100:00100000:0.0:1788940483.898827:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 14 00000100:00100000:0.0:1788940483.898840:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+20:10407:x1875839718296576:12345-192.168.202.14@tcp:35:lfs.0 00000100:00100000:0.0:1788940483.899513:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+21:10407:x1875839718296576:12345-192.168.202.14@tcp:35:lfs.0 Request processed in 674us (2240us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1788940483.899589:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 14 00000100:00100000:3.0:1788940484.149269:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940484.150131:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718296832 00000100:00100000:1.0:1788940484.150149:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718296832 00000100:00100000:1.0:1788940484.150245:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 57 00000100:00100000:1.0:1788940484.150260:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+21:10414:x1875839718296832:12345-192.168.202.14@tcp:101:bash.0 00010000:00010000:1.0:1788940484.150291:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940484.150315:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4af39 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f580d expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940484.150422:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4af40 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940484.150437:0:5862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4af24 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57ff expref: 22 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940484.150445:0:5862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4af40 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940484.150483:0:5862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4af24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57ff expref: 22 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940484.150507:0:5862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4af24 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57ff expref: 22 pid: 5862 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940484.150571:0:5862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf554e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5862:1875839738253952:192.168.202.14@tcp:104: 00000100:00100000:1.0:1788940484.150716:0:5862:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f188f2cb40 going to sleep for 11 seconds 00000100:00080000:3.0:1788940484.151738:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940484.154744:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940484.155555:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718296960 00000100:00100000:3.0:1788940484.155571:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718296960 00010000:00010000:3.0:1788940484.155621:0:5845:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4af24 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57ff expref: 23 pid: 5862 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940484.155672:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 40 00000100:00100000:3.0:1788940484.155683:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae81c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+23:2352:x1875839718296960:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940484.155700:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940484.155708:0:5845:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4af24 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57ff expref: 23 pid: 5862 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940484.155722:0:5845:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4af24 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57ff expref: 23 pid: 5862 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940484.155767:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89f188f81b00) 00010000:00010000:3.0:1788940484.155772:0:5845:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4af40 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940484.155782:0:5845:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4af40 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940484.155789:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4af40 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940484.155810:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940484.155878:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae81c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+23:2352:x1875839718296960:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 196us (1145us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940484.155886:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 40 00010000:00010000:1.0:1788940484.158092:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4af24 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57ff expref: 22 pid: 5862 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940484.158136:0:5862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf554e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5862:1875839738253952:192.168.202.14@tcp:104: 00010000:00010000:1.0:1788940484.158165:0:5862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4af40 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940484.158174:0:5862:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4af40 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940484.158181:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4af40 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940484.158203:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1788940484.158391:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4af39 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f580d expref: 23 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940484.158409:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4af40 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f580d expref: 22 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940484.158419:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89f188f81b00) 00010000:00010000:1.0:1788940484.158422:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788940484.158425:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f19258dc00, rc 0) 00000100:00100000:1.0:1788940484.158514:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+22:10414:x1875839718296832:12345-192.168.202.14@tcp:101:bash.0 Request processed in 8259us (9257us total) trans 4294967341 rc 0/0 00000100:00100000:1.0:1788940484.158567:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 57 00000100:00100000:2.0:1788940484.175562:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940484.175680:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718297216 00000100:00100000:0.0:1788940484.175693:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718297216 00000100:00100000:0.0:1788940484.175762:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 58 00000100:00100000:0.0:1788940484.175774:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f0821c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+22:10414:x1875839718297216:12345-192.168.202.14@tcp:36:bash.0 00010000:00010000:0.0:1788940484.176077:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4af4e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940484.176099:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4af4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940484.176772:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4af4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788940484.176855:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:0.0:1788940484.176890:0:5860:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009d937321 reply state 00000000f48383ab transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4af4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940484.176899:0:5860:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788940484.177460:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f0821c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+25:10414:x1875839718297216:12345-192.168.202.14@tcp:36:bash.0 Request processed in 1683us (1955us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1788940484.177486:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 58 00000020:00080000:0.0:1788940484.177492:0:5860:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788940484.181638:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4af4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940484.181657:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4af4e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940484.181666:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4af4e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940484.181672:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad2800 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940484.181677:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4af4e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940484.181685:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4af4e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940484.181732:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89f188f81b00) 00010000:00010000:3.0:1788940484.181735:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940484.181741:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4af4e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940484.181748:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4af4e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940484.187677:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940484.188276:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718297344 00000100:00100000:1.0:1788940484.188291:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718297344 00000100:00100000:1.0:1788940484.188365:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 59 00000100:00100000:1.0:1788940484.188377:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1aed94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+24:10414:x1875839718297344:12345-192.168.202.14@tcp:101:bash.0 00010000:00010000:1.0:1788940484.188431:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940484.188453:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4af55 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5814 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940484.188597:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4af5c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940484.188618:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4af40 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f580d expref: 25 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940484.188628:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4af5c lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940484.188668:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4af40 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f580d expref: 25 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940484.188682:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4af40 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f580d expref: 25 pid: 5862 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940484.188699:0:5861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf554e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5861:1875839738254080:192.168.202.14@tcp:104: 00000100:00100000:1.0:1788940484.188799:0:5861:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f194b3b180 going to sleep for 11 seconds 00000100:00100000:0.0:1788940484.194338:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940484.194454:0:5861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf554e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5861:1875839738254080:192.168.202.14@tcp:104: 00010000:00010000:1.0:1788940484.194484:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4af5c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940484.195467:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718297472 00000100:00100000:2.0:1788940484.195479:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718297472 00010000:00010000:2.0:1788940484.195578:0:8470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4af40 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f580d expref: 26 pid: 5862 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940484.195626:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 41 00000100:00100000:2.0:1788940484.195653:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf580000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+26:2353:x1875839718297472:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788940484.195670:0:8470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940484.195678:0:8470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4af40 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f580d expref: 26 pid: 5862 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940484.195691:0:8470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4af40 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f580d expref: 26 pid: 5862 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940484.195714:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4af40 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f580d expref: 26 pid: 5862 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940484.195731:0:8470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89f188f81b00) 00010000:00010000:2.0:1788940484.195735:0:8470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4af5c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940484.195745:0:8470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4af5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940484.195753:0:8470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4af5c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940484.195787:0:8470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940484.195847:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf580000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+25:2353:x1875839718297472:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 196us (1518us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940484.195854:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 41 00010000:00010000:1.0:1788940484.195940:0:5861:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4af5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940484.195948:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4af5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940484.196009:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788940484.196014:0:5861:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788940484.196037:0:5861:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4af5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940484.196069:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4af55 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5814 expref: 25 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940484.196084:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4af5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5814 expref: 24 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940484.196091:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89f188f81b00) 00010000:00010000:1.0:1788940484.196094:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788940484.196096:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f19258c200, rc 0) 00000100:00100000:1.0:1788940484.196123:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1aed94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+24:10414:x1875839718297344:12345-192.168.202.14@tcp:101:bash.0 Request processed in 7749us (8460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940484.196130:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 59 00000100:00100000:0.0:1788940484.204922:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940484.205251:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718297728 00000100:00100000:2.0:1788940484.205265:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718297728 00000100:00100000:2.0:1788940484.205338:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 15 00000100:00100000:2.0:1788940484.205351:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b0612c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+24:10414:x1875839718297728:12345-192.168.202.14@tcp:35:bash.0 00000100:00100000:2.0:1788940484.205679:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b0612c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+25:10414:x1875839718297728:12345-192.168.202.14@tcp:35:bash.0 Request processed in 329us (767us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1788940484.205687:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 15 00010000:00010000:3.0:1788940484.268804:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940484.415952:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940484.416120:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718297984 00000100:00100000:1.0:1788940484.416133:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718297984 00000100:00100000:1.0:1788940484.416205:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 60 00000100:00100000:1.0:1788940484.416216:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf583800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+25:10424:x1875839718297984:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:1.0:1788940484.416242:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940484.416264:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4af63 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f581b expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940484.416380:0:5860:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788940484.416506:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4af63 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f581b expref: 27 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940484.416561:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f1983af400) 00010000:00010000:1.0:1788940484.416565:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788940484.416571:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4af63 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f581b expref: 27 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940484.416586:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f19258c600, rc 0) 00000100:00100000:1.0:1788940484.416644:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf583800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+26:10424:x1875839718297984:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 430us (702us total) trans 4294967345 rc 301/301 00000100:00100000:1.0:1788940484.416652:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 60 00000100:00100000:1.0:1788940484.435063:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940484.435204:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718298112 00000100:00100000:3.0:1788940484.435216:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718298112 00000100:00100000:3.0:1788940484.435280:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 61 00000100:00100000:3.0:1788940484.435291:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf554e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+26:10424:x1875839718298112:12345-192.168.202.14@tcp:34:lfs.0 00010000:00010000:3.0:1788940484.435373:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031a00/0x27a633fcdd4af71 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940484.435390:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031a00/0x27a633fcdd4af71 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940484.435402:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031a00/0x27a633fcdd4af71 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940484.435418:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4af78 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940484.435424:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4af78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940484.435430:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4af78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940484.435800:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4af7f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940484.435810:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4af7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940484.435818:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4af7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788940484.435869:0:5862:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4af7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940484.435881:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031a00/0x27a633fcdd4af71 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940484.435888:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031a00/0x27a633fcdd4af71 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940484.435894:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031a00/0x27a633fcdd4af71 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940484.435900:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f180031a00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940484.435904:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031a00/0x27a633fcdd4af71 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940484.435911:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031a00/0x27a633fcdd4af71 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940484.435923:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89f188f81300) 00010000:00010000:3.0:1788940484.435927:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940484.435932:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031a00/0x27a633fcdd4af71 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940484.435944:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031a00/0x27a633fcdd4af71 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940484.435960:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4af78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940484.435966:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4af78 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940484.435972:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4af78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940484.435977:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f180030c00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940484.436171:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4af78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940484.436178:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4af78 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940484.436186:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff89f18a6cea00) 00010000:00010000:3.0:1788940484.436188:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940484.436192:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4af78 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940484.436197:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4af78 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940484.436213:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4af7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940484.436218:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4af7f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940484.436229:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4af7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940484.436233:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f180030400 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940484.436235:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4af7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940484.436241:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4af7f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940484.436249:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89f188f81b00) 00010000:00010000:3.0:1788940484.436251:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940484.436254:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4af7f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940484.436260:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4af7f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940484.436358:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf554e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+26:10424:x1875839718298112:12345-192.168.202.14@tcp:34:lfs.0 Request processed in 1066us (1302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940484.436367:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 61 00000100:00100000:0.0:1788940484.451488:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940484.451603:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718298368 00000100:00100000:2.0:1788940484.451616:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718298368 00000100:00100000:2.0:1788940484.451687:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 16 00000100:00100000:2.0:1788940484.451700:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf583b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+26:10424:x1875839718298368:12345-192.168.202.14@tcp:35:lfs.0 00000100:00100000:2.0:1788940484.452715:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf583b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+27:10424:x1875839718298368:12345-192.168.202.14@tcp:35:lfs.0 Request processed in 1000us (1217us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1788940484.452729:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 16 00000100:00100000:0.0:1788940484.497064:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940484.497213:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718298624 00000100:00100000:1.0:1788940484.497226:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718298624 00000100:00100000:1.0:1788940484.497295:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 62 00000100:00100000:1.0:1788940484.497308:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf583100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+27:10427:x1875839718298624:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:1.0:1788940484.497340:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940484.497364:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4af86 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5822 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940484.497452:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4af8d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940484.497466:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4af8d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940484.497479:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4af8d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940484.497574:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4af94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940484.497583:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4af94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940484.497590:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4af94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940484.498072:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258cc00/0x27a633fcdd4af9b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940484.498083:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258cc00/0x27a633fcdd4af9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940484.498091:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258cc00/0x27a633fcdd4af9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940484.498102:0:5860:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788940484.498206:0:5860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4af8d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940484.498214:0:5860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4af8d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940484.498220:0:5860:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4af8d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940484.498227:0:5860:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258d800 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940484.498231:0:5860:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4af8d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940484.498247:0:5860:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4af8d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940484.498259:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89f188f81300) 00010000:00010000:1.0:1788940484.498262:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940484.498266:0:5860:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4af8d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940484.498273:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4af8d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940484.498285:0:5860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4af94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940484.498291:0:5860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4af94 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940484.498297:0:5860:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4af94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940484.498302:0:5860:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258c000 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940484.498305:0:5860:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4af94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940484.498310:0:5860:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4af94 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940484.498316:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff89f188f81600) 00010000:00010000:1.0:1788940484.498318:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940484.498321:0:5860:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4af94 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940484.498334:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4af94 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940484.498380:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4af86 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5822 expref: 30 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940484.498393:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258cc00/0x27a633fcdd4af9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5822 expref: 29 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940484.498401:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89f188f81b00) 00010000:00010000:1.0:1788940484.498403:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788940484.498405:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f19258cc00, rc 0) 00000100:00100000:1.0:1788940484.498472:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf583100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+29:10427:x1875839718298624:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 1167us (1420us total) trans 4294967347 rc 0/0 00000100:00100000:1.0:1788940484.498480:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 62 00000100:00100000:1.0:1788940484.503777:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940484.503829:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940484.504281:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718298752 00000100:00100000:3.0:1788940484.504298:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718298752 00000100:00100000:3.0:1788940484.504389:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 4 00000100:00100000:3.0:1788940484.504403:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c6d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+29:2352:x1875839718298752:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940484.504423:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940484.504455:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258cc00/0x27a633fcdd4af9b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5822 expref: 29 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940484.504512:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89f188f81b00) 00010000:00010000:3.0:1788940484.504570:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940484.504634:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c6d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+28:2352:x1875839718298752:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 234us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940484.504641:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 4 00000100:00100000:2.0:1788940484.505275:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718298880 00000100:00100000:2.0:1788940484.505284:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718298880 00000100:00100000:2.0:1788940484.505329:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 63 00000100:00100000:2.0:1788940484.505339:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf554000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+28:10427:x1875839718298880:12345-192.168.202.14@tcp:54:lfs.0 00010000:00010000:2.0:1788940484.505415:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4afa9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940484.505432:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4afa9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940484.505443:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4afa9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940484.505469:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4afa9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940484.505476:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4afa9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940484.505508:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4afa9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940484.505515:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188dab800 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940484.505563:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4afa9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940484.505574:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4afa9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940484.505587:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89f188f81b00) 00010000:00010000:2.0:1788940484.505590:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788940484.505595:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4afa9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940484.505602:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4afa9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940484.505672:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf554000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+28:10427:x1875839718298880:12345-192.168.202.14@tcp:54:lfs.0 Request processed in 334us (1905us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940484.505680:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 63 00000100:00100000:1.0:1788940484.511002:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940484.511106:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718299136 00000100:00100000:0.0:1788940484.511119:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718299136 00000100:00100000:0.0:1788940484.511187:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 17 00000100:00100000:0.0:1788940484.511199:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+28:10427:x1875839718299136:12345-192.168.202.14@tcp:35:lfs.0 00000100:00100000:0.0:1788940484.511506:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+29:10427:x1875839718299136:12345-192.168.202.14@tcp:35:lfs.0 Request processed in 300us (509us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1788940484.511514:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 17 00000100:00100000:0.0:1788940484.810676:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940484.810770:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718299392 00000100:00100000:1.0:1788940484.810783:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718299392 00000100:00100000:1.0:1788940484.810855:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 64 00000100:00100000:1.0:1788940484.810867:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ba976d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+29:10445:x1875839718299392:12345-192.168.202.14@tcp:101:cat.0 00010000:00010000:1.0:1788940484.810895:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940484.810917:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4afb0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5829 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940484.811041:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4afb7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940484.811076:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4afb7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940484.811088:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4afb7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940484.811101:0:5860:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788940484.811235:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4afb0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5829 expref: 32 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940484.811254:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4afb7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5829 expref: 31 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940484.811261:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89f188f81b00) 00010000:00010000:1.0:1788940484.811264:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788940484.811267:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f19258d800, rc 0) 00000100:00100000:1.0:1788940484.811343:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ba976d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+31:10445:x1875839718299392:12345-192.168.202.14@tcp:101:cat.0 Request processed in 478us (679us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1788940484.811350:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 64 00000100:00100000:1.0:1788940484.875799:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940484.875924:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718299520 00000100:00100000:2.0:1788940484.875937:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718299520 00000100:00100000:2.0:1788940484.876016:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 65 00000100:00100000:2.0:1788940484.876029:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+31:10446:x1875839718299520:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:2.0:1788940484.876067:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940484.876089:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daae00/0x27a633fcdd4afc5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5830 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940484.876183:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa800/0x27a633fcdd4afcc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940484.876197:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa800/0x27a633fcdd4afcc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940484.876208:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa800/0x27a633fcdd4afcc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940484.876239:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788940484.876242:0:5861:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788940484.876269:0:5861:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa800/0x27a633fcdd4afcc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940484.876294:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daae00/0x27a633fcdd4afc5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5830 expref: 33 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940484.876313:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa800/0x27a633fcdd4afcc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5830 expref: 32 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940484.876320:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89f188f81300) 00010000:00010000:2.0:1788940484.876323:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788940484.876326:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f188daa800, rc 0) 00000100:00100000:2.0:1788940484.876388:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+32:10446:x1875839718299520:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 362us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940484.876395:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 65 00000100:00100000:2.0:1788940484.900428:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940484.900620:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718299904 00000100:00100000:0.0:1788940484.900633:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718299904 00000100:00100000:0.0:1788940484.900701:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 18 00000100:00100000:0.0:1788940484.900712:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1aed95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+32:10446:x1875839718299904:12345-192.168.202.14@tcp:35:lfs.0 00000100:00100000:0.0:1788940484.901086:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1aed95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+33:10446:x1875839718299904:12345-192.168.202.14@tcp:35:lfs.0 Request processed in 374us (667us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1788940484.901094:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 18 00000100:00100000:0.0:1788940484.907459:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940484.908713:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718300032 00000100:00100000:2.0:1788940484.908750:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718300032 00000100:00100000:2.0:1788940484.908854:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 5 00000100:00100000:2.0:1788940484.908867:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ba976a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+33:10446:x1875839718300032:12345-192.168.202.14@tcp:103:lfs.0 00010000:00010000:2.0:1788940484.908885:0:8470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788940484.908915:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4af5c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5814 expref: 33 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940484.908949:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4afb7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5829 expref: 32 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940484.908964:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4ae60 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f57d5 expref: 31 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940484.909161:0:8470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89f188f81b00) 00010000:00010000:2.0:1788940484.909175:0:8470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940484.909377:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ba976a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+30:10446:x1875839718300032:12345-192.168.202.14@tcp:103:lfs.0 Request processed in 511us (1927us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940484.909386:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 5 00000100:00100000:1.0:1788940484.930199:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940484.930387:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718300160 00000100:00100000:0.0:1788940484.930400:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718300160 00000100:00100000:0.0:1788940484.930473:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 66 00000100:00100000:0.0:1788940484.930503:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+30:10446:x1875839718300160:12345-192.168.202.14@tcp:58:lfs.0 00010000:00010000:0.0:1788940484.930669:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4afd3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940484.930689:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4afd3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940484.930702:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4afd3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788940484.931611:0:5860:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788940484.931805:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1788940484.931875:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1788940484.932001:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+30:10446:x1875839718300160:12345-192.168.202.14@tcp:58:lfs.0 Request processed in 1509us (1809us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940484.932010:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 66 00000100:00100000:1.0:1788940484.983842:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940484.983956:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718300288 00000100:00100000:2.0:1788940484.983968:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718300288 00000100:00100000:2.0:1788940484.984041:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 67 00000100:00100000:2.0:1788940484.984065:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5836a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+30:10448:x1875839718300288:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:2.0:1788940484.984089:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940484.984110:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daae00/0x27a633fcdd4afda lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5837 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940484.984174:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4afe1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940484.984204:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4afe1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940484.984216:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4afe1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940484.984231:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4afe8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940484.984238:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4afe8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940484.984244:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4afe8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940484.984584:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4afef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940484.984594:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4afef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940484.984601:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4afef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940484.984635:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788940484.984638:0:5861:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788940484.984654:0:5861:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4afef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940484.984664:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4afef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940484.984684:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4afe1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940484.984691:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4afe1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940484.984698:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4afe1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940484.984704:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188daa400 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940484.984708:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4afe1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940484.984716:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4afe1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940484.984730:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89f188f81300) 00010000:00010000:2.0:1788940484.984732:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940484.984738:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4afe1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940484.984743:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4afe1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940484.984757:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4afe8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940484.984762:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4afe8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940484.984767:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4afe8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940484.984777:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188daba00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940484.984780:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4afe8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940484.984787:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4afe8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940484.984794:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff89f186946400) 00010000:00010000:2.0:1788940484.984796:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940484.984799:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4afe8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940484.984804:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4afe8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940484.984835:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daae00/0x27a633fcdd4afda lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5837 expref: 32 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940484.984848:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4afef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5837 expref: 31 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940484.984854:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89f1983af100) 00010000:00010000:2.0:1788940484.984856:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788940484.984858:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f188dab600, rc 0) 00000100:00100000:2.0:1788940484.984929:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5836a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+31:10448:x1875839718300288:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 867us (1097us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940484.984936:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 67 00010000:00010000:3.0:1788940485.299019:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788940485.922371:0:12025:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788940485.922382:0:12025:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788940485.922416:0:12025:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788940485.922421:0:12025:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1788940485.934914:0:11708:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788940485.934922:0:11708:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788940485.934974:0:11708:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788940485.934980:0:11708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788940485.935724:0:11708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bfbd9180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11708:1875839738254208:192.168.202.14@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788940485.936761:0:11708:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f198099900 going to sleep for 11 seconds 00000100:00100000:3.0:1788940485.951098:0:11708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bfbd9180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11708:1875839738254208:192.168.202.14@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788940485.984871:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940485.991784:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718300416 00000100:00100000:1.0:1788940485.991804:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718300416 00000100:00100000:1.0:1788940485.991891:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 1 00000100:00100000:1.0:1788940485.991904:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ba976300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+31:10459:x1875839718300416:12345-192.168.202.14@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788940485.992878:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ba976300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+31:10459:x1875839718300416:12345-192.168.202.14@tcp:900:lhsmtool_posix.0 Request processed in 966us (8007us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940485.992907:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 1 00000100:00100000:2.0:1788940486.014645:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940486.015149:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718300544 00000100:00100000:0.0:1788940486.015162:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718300544 00000100:00100000:0.0:1788940486.015248:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 68 00000100:00100000:0.0:1788940486.015261:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1aed97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+31:10459:x1875839718300544:12345-192.168.202.14@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788940486.015298:0:5860:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788940486.015407:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1aed97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+31:10459:x1875839718300544:12345-192.168.202.14@tcp:53:lhsmtool_posix.0 Request processed in 149us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940486.015415:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 68 00000100:00080000:2.0:1788940486.015648:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788940486.029373:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940486.035725:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718300672 00000100:00100000:2.0:1788940486.035750:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718300672 00000100:00100000:2.0:1788940486.035856:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 69 00000100:00100000:2.0:1788940486.035870:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ba974e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+31:10459:x1875839718300672:12345-192.168.202.14@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788940486.035971:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4aff6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.035992:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4aff6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.036006:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4aff6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.036022:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4affd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.036030:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4affd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.036036:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4affd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.036070:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4b004 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.036079:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4b004 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.036086:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4b004 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940486.036143:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788940486.036157:0:5861:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788940486.036174:0:5861:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4b004 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.036188:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4aff6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.036196:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4aff6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.036205:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4aff6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.036210:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188daac00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940486.036218:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4aff6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.036227:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4aff6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.036241:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89f186946200) 00010000:00010000:2.0:1788940486.036245:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940486.036251:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4aff6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.036257:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4aff6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.036271:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4affd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.036276:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4affd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.036292:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4affd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.036297:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188dab400 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940486.036301:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4affd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.036307:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4affd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.036316:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff89f186946400) 00010000:00010000:2.0:1788940486.036319:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940486.036322:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4affd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.036326:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4affd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.036344:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4b004 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.036350:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4b004 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.036356:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4b004 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.036360:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188daa400 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940486.036362:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4b004 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.036377:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4b004 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.036384:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89f1983af100) 00010000:00010000:2.0:1788940486.036386:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940486.036389:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4b004 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.036394:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4b004 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940486.036511:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ba974e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+31:10459:x1875839718300672:12345-192.168.202.14@tcp:34:lhsmtool_posix.0 Request processed in 643us (7145us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940486.036542:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 69 00000100:00100000:1.0:1788940486.070940:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940486.071012:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718300928 00000100:00100000:1.0:1788940486.071025:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718300928 00000100:00100000:1.0:1788940486.071089:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 70 00000100:00100000:1.0:1788940486.071100:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+31:10459:x1875839718300928:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788940486.071124:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940486.071146:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4b00b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f583e expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940486.071251:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b012 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940486.071267:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b012 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940486.071279:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b012 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940486.071291:0:5860:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788940486.071393:0:5860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b012 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940486.071400:0:5860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b012 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940486.071406:0:5860:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b012 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940486.071412:0:5860:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258c400 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940486.071425:0:5860:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b012 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940486.071434:0:5860:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b012 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940486.071446:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89f1983af100) 00010000:00010000:1.0:1788940486.071450:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788940486.071455:0:5860:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b012 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940486.071462:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b012 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940486.071516:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4b00b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f583e expref: 33 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940486.071553:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89f186946200) 00010000:00010000:1.0:1788940486.071556:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788940486.071561:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4b00b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f583e expref: 33 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940486.071571:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f19258c600, rc 0) 00000100:00100000:1.0:1788940486.071634:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+32:10459:x1875839718300928:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 536us (705us total) trans 4294967351 rc 301/301 00000100:00100000:1.0:1788940486.071643:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 70 00000100:00100000:2.0:1788940486.089048:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940486.089760:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718301056 00000100:00100000:3.0:1788940486.089778:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718301056 00000100:00100000:3.0:1788940486.089856:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 71 00000100:00100000:3.0:1788940486.089869:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1aed95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+32:10459:x1875839718301056:12345-192.168.202.14@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788940486.089911:0:5861:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788940486.090044:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1aed95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+32:10459:x1875839718301056:12345-192.168.202.14@tcp:53:lhsmtool_posix.0 Request processed in 177us (1006us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940486.090052:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 71 00000100:00100000:1.0:1788940486.103328:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940486.103440:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718301312 00000100:00100000:3.0:1788940486.103455:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718301312 00000100:00100000:3.0:1788940486.103565:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 72 00000100:00100000:3.0:1788940486.103582:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+32:10459:x1875839718301312:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788940486.103646:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940486.103650:0:5860:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788940486.103692:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa800/0x27a633fcdd4afcc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5830 expref: 32 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940486.103712:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89f188f81300) 00010000:00010000:3.0:1788940486.103719:0:5860:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788940486.103738:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b020 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5845 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788940486.104475:0:5860:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1788940486.104847:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b027 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940486.104867:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b027 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940486.104878:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b027 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940486.104937:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b020 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5845 expref: 34 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940486.104957:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b027 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5845 expref: 33 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940486.104965:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff89f18a6ced00) 00010000:00010000:3.0:1788940486.104968:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788940486.104971:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f180030c00, rc 0) 00000100:00100000:3.0:1788940486.105062:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+33:10459:x1875839718301312:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 1484us (1748us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1788940486.105071:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 72 00000100:00100000:2.0:1788940486.124361:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940486.132193:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718301568 00000100:00100000:3.0:1788940486.132216:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718301568 00000100:00100000:3.0:1788940486.132383:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 73 00000100:00100000:3.0:1788940486.132398:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f191021180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+33:10459:x1875839718301568:12345-192.168.202.14@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788940486.132469:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940486.132511:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b027 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5845 expref: 33 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940486.132552:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff89f18a6ced00) 00010000:00010000:3.0:1788940486.132565:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788940486.132590:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b035 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940486.132604:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b035 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940486.132791:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b035 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940486.132848:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031a00/0x27a633fcdd4b03c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xdf7d1462 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940486.132857:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031a00/0x27a633fcdd4b03c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xdf7d1462 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940486.132866:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031a00/0x27a633fcdd4b03c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xdf7d1462 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940486.133197:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b035 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940486.133206:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b035 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940486.133213:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b035 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940486.133219:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f180030400 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940486.133224:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b035 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940486.133234:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b035 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940486.133243:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89f188f81300) 00010000:00010000:3.0:1788940486.133246:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940486.133250:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b035 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940486.133256:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b035 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940486.133266:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031a00/0x27a633fcdd4b03c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xdf7d1462 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940486.133272:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031a00/0x27a633fcdd4b03c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xdf7d1462 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940486.133278:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031a00/0x27a633fcdd4b03c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xdf7d1462 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940486.133290:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f180031a00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940486.133294:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031a00/0x27a633fcdd4b03c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xdf7d1462 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940486.133301:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031a00/0x27a633fcdd4b03c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xdf7d1462 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940486.133309:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xdf7d1462 (ffff89f18a6cee00) 00010000:00010000:3.0:1788940486.133312:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940486.133315:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031a00/0x27a633fcdd4b03c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xdf7d1462 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940486.133320:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031a00/0x27a633fcdd4b03c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xdf7d1462 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940486.134840:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f191021180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+32:10459:x1875839718301568:12345-192.168.202.14@tcp:36:lhsmtool_posix.0 Request processed in 2431us (10481us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788940486.134853:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 73 00000100:00100000:3.0:1788940486.158824:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940486.158925:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718301696 00000100:00100000:0.0:1788940486.158939:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718301696 00000100:00100000:0.0:1788940486.159025:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 74 00000100:00100000:0.0:1788940486.159038:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+32:10459:x1875839718301696:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788940486.159067:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940486.159095:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b043 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f584c expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940486.159140:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b04a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940486.159154:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b04a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940486.159167:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b04a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940486.159292:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b043 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f584c expref: 34 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940486.159310:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b04a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f584c expref: 33 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940486.159318:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff89f1983af600) 00010000:00010000:0.0:1788940486.159321:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788940486.159325:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f082ad2000, rc 0) 00000100:00100000:0.0:1788940486.159393:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+33:10459:x1875839718301696:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 357us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940486.159411:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 74 00000100:00100000:1.0:1788940486.172966:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940486.173074:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718301952 00000100:00100000:3.0:1788940486.173087:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718301952 00000100:00100000:3.0:1788940486.173165:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 75 00000100:00100000:3.0:1788940486.173177:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+33:10459:x1875839718301952:12345-192.168.202.14@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788940486.173274:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031a00/0x27a633fcdd4b051 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940486.173297:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031a00/0x27a633fcdd4b051 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940486.173325:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031a00/0x27a633fcdd4b051 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788940486.173818:0:5862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1788940486.173832:0:5862:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 429072313181ns, next at 430072308850ns, rc = 0 00000004:00010000:3.0:1788940486.173929:0:5862:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000038debb7b reply state 0000000045730a2c transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031a00/0x27a633fcdd4b051 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940486.173938:0:5862:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788940486.174091:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+35:10459:x1875839718301952:12345-192.168.202.14@tcp:36:lhsmtool_posix.0 Request processed in 914us (1134us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1788940486.174099:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 75 00010000:00010000:3.0:1788940486.193350:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031a00/0x27a633fcdd4b051 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940486.193371:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031a00/0x27a633fcdd4b051 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940486.193379:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031a00/0x27a633fcdd4b051 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940486.193385:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f180031a00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940486.193390:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031a00/0x27a633fcdd4b051 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940486.193398:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031a00/0x27a633fcdd4b051 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940486.193416:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff89f1983af600) 00010000:00010000:3.0:1788940486.193419:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788940486.193442:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031a00/0x27a633fcdd4b051 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940486.193450:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031a00/0x27a633fcdd4b051 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940486.198498:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940486.198572:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718302080 00000100:00100000:3.0:1788940486.198585:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718302080 00000100:00100000:3.0:1788940486.198646:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 76 00000100:00100000:3.0:1788940486.198659:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+34:10459:x1875839718302080:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788940486.198688:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940486.198713:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b058 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5853 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940486.198779:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b058 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5853 expref: 35 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940486.198795:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b058 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5853 expref: 35 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940486.198817:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff89f1983af600) 00010000:00010000:3.0:1788940486.198821:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788940486.198825:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f180030400, rc 0) 00000100:00100000:3.0:1788940486.198884:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+35:10459:x1875839718302080:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 228us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940486.198891:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 76 00000100:00100000:2.0:1788940486.212790:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940486.212831:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718302208 00000100:00100000:2.0:1788940486.212844:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718302208 00000100:00100000:2.0:1788940486.212893:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 25 00000100:00100000:2.0:1788940486.212904:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae7caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2349:x1875839718302208:12345-192.168.202.14@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1788940486.214774:0:6707:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 9c51ff78-d02d-4e61-8a10-a2f8830f1679@192.168.202.14@tcp t0 exp 0000000000000000 cur 429 last 0 00000020:00000080:2.0:1788940486.214817:0:6707:0:(genops.c:1393:class_connect()) connect: client 9c51ff78-d02d-4e61-8a10-a2f8830f1679, cookie 0x27a633fcdd4b05f 00002000:00100000:2.0:1788940486.214831:0:6707:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 9c51ff78-d02d-4e61-8a10-a2f8830f1679/ffff89f1b8970000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788940486.214858:0:6707:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788940486.215674:0:6707:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788940486.215728:0:6707:0:(import.c:65:import_set_state_nolock()) ffff89f1b8975000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788940486.216404:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae7caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2349:x1875839718302208:12345-192.168.202.14@tcp:8:lhsmtool_posix.0 Request processed in 3495us (3619us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940486.216420:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 25 00000100:00100000:2.0:1788940486.220574:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940486.220608:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718302336 00000100:00100000:2.0:1788940486.220620:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718302336 00000100:00100000:2.0:1788940486.220684:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 26 00000100:00100000:2.0:1788940486.220694:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae81d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:0:x1875839718302336:12345-192.168.202.14@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1788940486.220982:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1788940486.310442:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:2.0:1788940486.310459:0:6732:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9c51ff78-d02d-4e61-8a10-a2f8830f1679 00000100:00100000:3.0:1788940486.310889:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae81d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+5:0:x1875839718302336:12345-192.168.202.14@tcp:2:lhsmtool_posix.0 Request processed in 90189us (90318us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788940486.310921:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 26 00000100:00100000:3.0:1788940486.315159:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940486.316911:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718302592 00000100:00100000:0.0:1788940486.316928:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718302592 00000100:00100000:0.0:1788940486.317006:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 19 00000100:00100000:0.0:1788940486.317018:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+35:10459:x1875839718302592:12345-192.168.202.14@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788940486.317312:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+36:10459:x1875839718302592:12345-192.168.202.14@tcp:35:lhsmtool_posix.0 Request processed in 295us (2159us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1788940486.317320:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 19 00010000:00010000:0.0:1788940486.317381:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940486.323644:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940486.323814:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718302848 00000100:00100000:3.0:1788940486.323832:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718302848 00000100:00100000:3.0:1788940486.323902:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 77 00000100:00100000:3.0:1788940486.323915:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ba976680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+36:10459:x1875839718302848:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788940486.324049:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ba976680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+36:10459:x1875839718302848:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 Request processed in 136us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940486.324057:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 77 00000100:00100000:3.0:1788940486.327318:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940486.327438:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718302976 00000100:00100000:0.0:1788940486.327449:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718302976 00000100:00100000:0.0:1788940486.327558:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 78 00000100:00100000:0.0:1788940486.327571:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+36:10459:x1875839718302976:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788940486.327592:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940486.327613:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b066 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f585a expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940486.327695:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3200/0x27a633fcdd4b06d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940486.327709:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3200/0x27a633fcdd4b06d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940486.327721:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3200/0x27a633fcdd4b06d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940486.327779:0:5860:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788940486.327799:0:5860:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3200/0x27a633fcdd4b06d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940486.327826:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b066 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f585a expref: 38 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940486.327846:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3200/0x27a633fcdd4b06d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f585a expref: 37 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940486.327855:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff89f1983af600) 00010000:00010000:0.0:1788940486.327858:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788940486.327861:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f082ad3200, rc 0) 00000100:00100000:0.0:1788940486.327919:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+37:10459:x1875839718302976:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 350us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940486.327925:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 78 00000100:00100000:1.0:1788940486.331732:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940486.331877:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718303104 00000100:00100000:0.0:1788940486.331890:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718303104 00000100:00100000:0.0:1788940486.331970:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 27 00000100:00100000:0.0:1788940486.331981:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5834380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+5:2351:x1875839718303104:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788940486.332004:0:6708:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940486.332026:0:6708:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000133c7c80/0x27a633fcdd4b074 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5861 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788940486.332053:0:6708:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa110c7, blocks: 0x1 00010000:00010000:0.0:1788940486.332077:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=429s v=(0 0) 00010000:00010000:0.0:1788940486.332100:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940486.332111:0:6708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133c7c80/0x27a633fcdd4b074 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5861 expref: 6 pid: 6708 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940486.332139:0:6708:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000133c7c80/0x27a633fcdd4b074 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5861 expref: 6 pid: 6708 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940486.332153:0:6708:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f082ad3800, rc 0) 00000100:00100000:0.0:1788940486.332212:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5834380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2351:x1875839718303104:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 233us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940486.332219:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 27 00000100:00100000:1.0:1788940486.336597:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940486.336738:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718303360 00000100:00100000:3.0:1788940486.336751:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718303360 00000100:00100000:3.0:1788940486.336824:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 79 00000100:00100000:3.0:1788940486.336837:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+37:10459:x1875839718303360:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788940486.336973:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+37:10459:x1875839718303360:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 Request processed in 138us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940486.336981:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 79 00000100:00100000:3.0:1788940486.340616:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940486.340799:0:7074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718303488 00000100:00100000:2.0:1788940486.340813:0:7074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718303488 00000100:00100000:2.0:1788940486.340879:0:7074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 28 00000100:00100000:2.0:1788940486.340891:0:7074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:10459:x1875839718303488:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788940486.340917:0:7074:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940486.340954:0:7074:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb62cd4d/0x27a633fcdd4b07b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5868 expref: -99 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.340995:0:7074:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000133c7c80/0x27a633fcdd4b074 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5861 expref: 7 pid: 6708 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.341006:0:7074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940486.341010:0:7074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940486.341016:0:7074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb62cd4d/0x27a633fcdd4b07b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5868 expref: 7 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.341099:0:7074:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000133c7c80/0x27a633fcdd4b074 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5861 expref: 7 pid: 6708 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.341115:0:7074:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000133c7c80/0x27a633fcdd4b074 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5861 expref: 7 pid: 6708 timeout: 529 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940486.341131:0:7074:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5831f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7074:1875839738254336:192.168.202.14@tcp:104: 00000100:00100000:2.0:1788940486.341243:0:7074:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1bf5b49c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788940486.345273:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940486.345404:0:7074:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5831f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7074:1875839738254336:192.168.202.14@tcp:104: 00010000:00010000:2.0:1788940486.345440:0:7074:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cb62cd4d/0x27a633fcdd4b07b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5868 expref: 7 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.345460:0:7074:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f188dab800, rc 0) 00000100:00100000:2.0:1788940486.345580:0:7074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+7:10459:x1875839718303488:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 4690us (4972us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940486.345589:0:7074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 28 00000100:00100000:3.0:1788940486.346261:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718303616 00000100:00100000:3.0:1788940486.346272:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718303616 00010000:00010000:3.0:1788940486.346314:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000133c7c80/0x27a633fcdd4b074 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5861 expref: 7 pid: 6708 timeout: 529 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940486.346358:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 42 00000100:00100000:3.0:1788940486.346369:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1841b7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+7:2353:x1875839718303616:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940486.346418:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940486.346443:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000133c7c80/0x27a633fcdd4b074 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5861 expref: 7 pid: 6708 timeout: 529 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940486.346457:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000133c7c80/0x27a633fcdd4b074 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5861 expref: 7 pid: 6708 timeout: 529 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940486.346498:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000133c7c80/0x27a633fcdd4b074 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5861 expref: 7 pid: 6708 timeout: 529 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940486.346604:0:5846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940486.346610:0:5846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940486.346619:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cb62cd4d/0x27a633fcdd4b07b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5868 expref: 6 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940486.346631:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb62cd4d/0x27a633fcdd4b07b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5868 expref: 6 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940486.346669:0:5846:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000cb62cd4d/0x27a633fcdd4b07b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5868 expref: 6 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940486.346684:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bfbd9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5846:1875839738254464:192.168.202.14@tcp:105: 00000100:00100000:3.0:1788940486.346768:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f198099900 going to sleep for 11 seconds 00000100:00100000:1.0:1788940486.355941:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940486.356056:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bfbd9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5846:1875839738254464:192.168.202.14@tcp:105: 00010000:00010000:3.0:1788940486.356083:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940486.356168:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1841b7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2353:x1875839718303616:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 9799us (10905us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940486.356181:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 42 00000100:00100000:2.0:1788940486.356867:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718303744 00000100:00100000:2.0:1788940486.356879:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718303744 00002000:00100000:2.0:1788940486.356940:0:6713:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff89f1b5835500 x1875839718303744/t0(0) o4->9c51ff78-d02d-4e61-8a10-a2f8830f1679@192.168.202.14@tcp:462/0 lens 504/0 e 0 to 0 dl 1788940497 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788940486.356953:0:6713:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89f1b5835500 with x1875839718303744 ext(0->8) 00002000:00010000:2.0:1788940486.356958:0:6713:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89f1b5835500 00000100:00100000:2.0:1788940486.356993:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 0 00000100:00100000:2.0:1788940486.357004:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5835500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2352:x1875839718303744:12345-192.168.202.14@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788940486.357889:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5835500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+8:2352:x1875839718303744:12345-192.168.202.14@tcp:4:lhsmtool_posix.0 Request processed in 884us (1965us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788940486.357899:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 0 00002000:00100000:2.0:1788940486.357907:0:6713:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff89f1b5835500 x1875839718303744/t4294967302(0) o4->9c51ff78-d02d-4e61-8a10-a2f8830f1679@192.168.202.14@tcp:462/0 lens 504/448 e 0 to 0 dl 1788940497 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788940486.357916:0:6713:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89f1b5835500 with x1875839718303744 ext(0->8) 00002000:00010000:2.0:1788940486.357921:0:6713:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89f1b5835500 00000100:00100000:1.0:1788940486.373418:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940486.375919:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718303872 00000100:00100000:0.0:1788940486.375994:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718303872 00000100:00100000:1.0:1788940486.379345:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 80 00000100:00100000:1.0:1788940486.379362:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5834700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+37:10459:x1875839718303872:12345-192.168.202.14@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788940486.464665:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:1.0:1788940486.464724:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:1.0:1788940486.464742:0:5883:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:1.0:1788940486.464893:0:5894:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:1.0:1788940486.464914:0:5894:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1788940486.464944:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738254592:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788940486.465024:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940486.465798:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5834700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+13:10459:x1875839718303872:12345-192.168.202.14@tcp:44:lhsmtool_posix.0 Request processed in 86432us (92381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940486.465812:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 80 00000100:00100000:1.0:1788940486.466053:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738254592 00000100:00100000:1.0:1788940486.466063:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738254592 00000100:00100000:1.0:1788940486.466210:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788940486.466221:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5835f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738254592:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788940486.466640:0:6708:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788940486.466645:0:6708:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788940487 00002000:00010000:1.0:1788940486.466647:0:6708:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788940486.466649:0:6708:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788940487 -> 1788940487 00002000:00010000:1.0:1788940486.466651:0:6708:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788940486.466714:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5835f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1875839738254592:12345-0@lo:2:osp-syn-0-0.0 Request processed in 495us (1689us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788940486.466721:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:1.0:1788940486.470650:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89f1b5837480/2, rc 0, transno 4294967303 00000100:00100000:1.0:1788940486.470667:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738254592:0@lo:2:osp-syn-0-0.0 00000100:00080000:3.0:1788940486.471592:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788940486.473061:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940486.473231:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718304000 00000100:00100000:3.0:1788940486.473311:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718304000 00000100:00100000:3.0:1788940486.473413:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 30 00000100:00100000:3.0:1788940486.473424:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5831f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+8:2353:x1875839718304000:12345-192.168.202.14@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1788940486.505122:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:2.0:1788940486.505140:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:3.0:1788940486.505427:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5831f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2353:x1875839718304000:12345-192.168.202.14@tcp:16:lhsmtool_posix.0 Request processed in 31998us (32367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940486.505440:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 30 00000100:00100000:1.0:1788940486.508683:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940486.508731:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718304256 00000100:00100000:3.0:1788940486.508744:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718304256 00000100:00100000:3.0:1788940486.508806:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 81 00000100:00100000:3.0:1788940486.508815:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+13:10459:x1875839718304256:12345-192.168.202.14@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788940486.508983:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940486.509015:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3200/0x27a633fcdd4b06d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f585a expref: 13 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940486.509035:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff89f1983af600) 00010000:00010000:3.0:1788940486.509040:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788940486.509073:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031a00/0x27a633fcdd4b082 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940486.509109:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031a00/0x27a633fcdd4b082 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940486.509121:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031a00/0x27a633fcdd4b082 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788940486.509406:0:5861:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c08b67f2 reply state 00000000232ca46d transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031a00/0x27a633fcdd4b082 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940486.509413:0:5861:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788940486.509710:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+14:10459:x1875839718304256:12345-192.168.202.14@tcp:36:lhsmtool_posix.0 Request processed in 893us (1034us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1788940486.509718:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 81 00010000:00010000:3.0:1788940486.514363:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031a00/0x27a633fcdd4b082 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940486.514383:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031a00/0x27a633fcdd4b082 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940486.514392:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031a00/0x27a633fcdd4b082 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940486.514398:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f180031a00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940486.514404:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031a00/0x27a633fcdd4b082 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940486.514412:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031a00/0x27a633fcdd4b082 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940486.514432:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff89f1983af600) 00010000:00010000:3.0:1788940486.514452:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940486.514459:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031a00/0x27a633fcdd4b082 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940486.514466:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031a00/0x27a633fcdd4b082 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940486.516112:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940486.516230:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718304384 00000100:00100000:0.0:1788940486.516316:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718304384 00000100:00100000:0.0:1788940486.516395:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 31 00000100:00100000:0.0:1788940486.516407:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f192603450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2352:x1875839718304384:12345-192.168.202.14@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788940486.518739:0:6708:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1788940486.518749:0:6708:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788940487 -> 1788940485 00002000:00010000:0.0:1788940486.518753:0:6708:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788940482 00002000:00010000:0.0:1788940486.518755:0:6708:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788940487 -> 1788940485 00002000:00010000:0.0:1788940486.518758:0:6708:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788940486.520045:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f192603450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+7:2352:x1875839718304384:12345-192.168.202.14@tcp:2:lhsmtool_posix.0 Request processed in 3629us (3931us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788940486.520062:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 31 00000100:00100000:0.0:1788940486.536598:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940486.540060:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718304640 00000100:00100000:3.0:1788940486.540081:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718304640 00000100:00100000:0.0:1788940486.541063:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 82 00000100:00100000:0.0:1788940486.541096:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ba974380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+13:10459:x1875839718304640:12345-192.168.202.14@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788940486.541176:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b089 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940486.541195:0:7857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b04a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f584c expref: 13 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940486.541205:0:7857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b089 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940486.541255:0:7857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b04a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f584c expref: 13 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940486.541269:0:7857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b04a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f584c expref: 13 pid: 5860 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940486.541284:0:7857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ba975180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7857:1875839738254720:192.168.202.14@tcp:104: 00000100:00100000:0.0:1788940486.541398:0:7857:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f18a613b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788940486.551378:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940486.551560:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718304768 00000100:00100000:2.0:1788940486.551573:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718304768 00010000:00010000:2.0:1788940486.551621:0:8470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b04a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f584c expref: 14 pid: 5860 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940486.551670:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 43 00000100:00100000:2.0:1788940486.551682:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ba975500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+14:2353:x1875839718304768:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788940486.551698:0:8470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940486.551706:0:8470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b04a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f584c expref: 14 pid: 5860 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.551720:0:8470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b04a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f584c expref: 14 pid: 5860 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.551743:0:8470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff89f1983af600) 00010000:00010000:2.0:1788940486.551749:0:8470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b089 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.551776:0:8470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b089 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.551785:0:8470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b089 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.551806:0:8470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940486.551878:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ba975500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+14:2353:x1875839718304768:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 198us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940486.551886:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 43 00010000:00010000:3.0:1788940486.552262:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b04a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f584c expref: 13 pid: 5860 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940486.552282:0:7857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ba975180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7857:1875839738254720:192.168.202.14@tcp:104: 00010000:00010000:3.0:1788940486.552304:0:7857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b089 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940486.552313:0:7857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b089 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940486.552319:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b089 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940486.552344:0:7857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b089 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940486.552350:0:7857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b089 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940486.552355:0:7857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b089 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940486.552360:0:7857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad3800 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940486.552371:0:7857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b089 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940486.552379:0:7857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b089 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940486.552390:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff89f1983af600) 00010000:00010000:3.0:1788940486.552393:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788940486.552396:0:7857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b089 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940486.552402:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b089 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940486.552441:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ba974380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+12:10459:x1875839718304640:12345-192.168.202.14@tcp:55:lhsmtool_posix.0 Request processed in 11349us (15852us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788940486.552448:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 82 00000100:00100000:1.0:1788940486.556104:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940486.556366:0:7074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718304896 00000100:00100000:2.0:1788940486.556378:0:7074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718304896 00000100:00100000:2.0:1788940486.556445:0:7074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 32 00000100:00100000:2.0:1788940486.556457:0:7074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5834000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+7:2352:x1875839718304896:12345-192.168.202.14@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788940486.556564:0:7074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000a5e6d01/0x27a633fcdd4b090 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.556587:0:7074:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cb62cd4d/0x27a633fcdd4b07b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5868 expref: 7 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.556598:0:7074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940486.556602:0:7074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788940486.556606:0:7074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a5e6d01/0x27a633fcdd4b090 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.556645:0:7074:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cb62cd4d/0x27a633fcdd4b07b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5868 expref: 7 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.556682:0:7074:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cb62cd4d/0x27a633fcdd4b07b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5868 expref: 7 pid: 7074 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940486.556697:0:7074:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5831880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7074:1875839738254848:192.168.202.14@tcp:104: 00000100:00100000:2.0:1788940486.556781:0:7074:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1bf5b4840 going to sleep for 11 seconds 00000100:00100000:1.0:1788940486.566733:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940486.567329:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718305024 00000100:00100000:3.0:1788940486.567342:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718305024 00010000:00010000:3.0:1788940486.567387:0:5845:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cb62cd4d/0x27a633fcdd4b07b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5868 expref: 8 pid: 7074 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940486.567438:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 44 00000100:00100000:3.0:1788940486.567447:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5835c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+8:2353:x1875839718305024:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940486.567463:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940486.567709:0:5845:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cb62cd4d/0x27a633fcdd4b07b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5868 expref: 8 pid: 7074 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940486.567727:0:5845:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cb62cd4d/0x27a633fcdd4b07b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5868 expref: 8 pid: 7074 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940486.567768:0:5845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788940486.567773:0:5845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788940486.567779:0:5845:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000a5e6d01/0x27a633fcdd4b090 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940486.567791:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a5e6d01/0x27a633fcdd4b090 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940486.567814:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940486.568461:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5835c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+8:2353:x1875839718305024:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 1008us (1730us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940486.568472:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 44 00010000:00010000:2.0:1788940486.570351:0:7074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb62cd4d/0x27a633fcdd4b07b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5868 expref: 7 pid: 7074 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940486.570377:0:7074:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5831880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7074:1875839738254848:192.168.202.14@tcp:104: 00010000:00010000:2.0:1788940486.570403:0:7074:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000a5e6d01/0x27a633fcdd4b090 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.570414:0:7074:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000a5e6d01/0x27a633fcdd4b090 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.570421:0:7074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a5e6d01/0x27a633fcdd4b090 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.570465:0:7074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000a5e6d01/0x27a633fcdd4b090 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.570472:0:7074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a5e6d01/0x27a633fcdd4b090 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.570561:0:7074:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a5e6d01/0x27a633fcdd4b090 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.570568:0:7074:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188daa600 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:2.0:1788940486.570572:0:7074:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a5e6d01/0x27a633fcdd4b090 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.570581:0:7074:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a5e6d01/0x27a633fcdd4b090 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.570598:0:7074:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a5e6d01/0x27a633fcdd4b090 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.570606:0:7074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a5e6d01/0x27a633fcdd4b090 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940486.570690:0:7074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5834000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2352:x1875839718304896:12345-192.168.202.14@tcp:1:lhsmtool_posix.0 Request processed in 14235us (14601us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940486.570699:0:7074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 32 00000100:00100000:1.0:1788940486.583189:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940486.583379:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718305280 00000100:00100000:0.0:1788940486.583391:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718305280 00000100:00100000:0.0:1788940486.583552:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 83 00000100:00100000:0.0:1788940486.583565:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5834a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+12:10459:x1875839718305280:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788940486.583659:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3c00/0x27a633fcdd4b097 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940486.583693:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3c00/0x27a633fcdd4b097 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940486.583704:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3c00/0x27a633fcdd4b097 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940486.584084:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b09e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940486.584098:0:5862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b058 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5853 expref: 13 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940486.584107:0:5862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b09e lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940486.584146:0:5862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b058 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5853 expref: 13 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940486.584161:0:5862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b058 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5853 expref: 13 pid: 5860 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940486.584175:0:5862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ba974700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5862:1875839738254976:192.168.202.14@tcp:104: 00000100:00100000:0.0:1788940486.585744:0:5862:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f18a613a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788940486.593604:0:5862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ba974700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5862:1875839738254976:192.168.202.14@tcp:104: 00010000:00010000:0.0:1788940486.593643:0:5862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b09e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940486.596964:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940486.597249:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718305408 00000100:00100000:2.0:1788940486.597264:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718305408 00010000:00010000:2.0:1788940486.597316:0:8470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b058 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5853 expref: 14 pid: 5860 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940486.597367:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 45 00000100:00100000:2.0:1788940486.597397:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5837100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+14:2352:x1875839718305408:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788940486.597413:0:8470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940486.597422:0:8470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b058 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5853 expref: 14 pid: 5860 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.597436:0:8470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b058 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5853 expref: 14 pid: 5860 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.597459:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b058 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5853 expref: 14 pid: 5860 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.597488:0:8470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff89f1983af600) 00010000:00010000:2.0:1788940486.597493:0:8470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b09e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.597501:0:8470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b09e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.597508:0:8470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b09e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.597574:0:8470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940486.597628:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5837100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+13:2352:x1875839718305408:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 235us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940486.597635:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 45 00010000:00010000:2.0:1788940486.597660:0:5862:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b09e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.597667:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b09e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788940486.597854:0:5862:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:2.0:1788940486.598014:0:5862:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:2.0:1788940486.598058:0:5862:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:2.0:1788940486.598140:0:5862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5831880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5862:1875839738255104:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788940486.598192:0:5862:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940486.598221:0:5862:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1bf5b49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940486.598247:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738255104 00000100:00100000:2.0:1788940486.598252:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738255104 00000100:00100000:2.0:1788940486.598283:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788940486.598289:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5830000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5862:x1875839738255104:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788940486.598353:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5830000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5862:x1875839738255104:12345-0@lo:1000:mdt00_002.0 Request processed in 63us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940486.598358:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788940486.598391:0:5862:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1788940486.598396:0:5862:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89f1b5837480, transno 4294967303 00000100:00100000:2.0:1788940486.598407:0:5862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5831880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5862:1875839738255104:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1788940486.598872:0:5862:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1788940486.598921:0:5862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5831880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5862:1875839738255232:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788940486.598949:0:5862:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940486.598968:0:5862:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1bf5b4840 going to sleep for 11 seconds 00000100:00100000:2.0:1788940486.599150:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738255232 00000100:00100000:2.0:1788940486.599156:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738255232 00000100:00100000:2.0:1788940486.599184:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788940486.599191:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5862:x1875839738255232:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788940486.599342:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5862:x1875839738255232:12345-0@lo:1000:mdt00_002.0 Request processed in 151us (391us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788940486.599358:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788940486.599396:0:5862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5831880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5862:1875839738255232:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1788940486.599447:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b09e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.599455:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b09e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.599462:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b09e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.599468:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad3800 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940486.599471:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b09e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.599491:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b09e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.599505:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff89f1983af600) 00010000:00010000:2.0:1788940486.599508:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788940486.599512:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b09e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.599545:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b09e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.599583:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4afd3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.599590:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4afd3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.599605:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4afd3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.599610:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad2e00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940486.599613:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4afd3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.599619:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4afd3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.599627:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89f1983af100) 00010000:00010000:2.0:1788940486.599630:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788940486.599633:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4afd3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.599638:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4afd3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.599662:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b0a5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.599676:0:5862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4afef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5837 expref: 16 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.599684:0:5862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b0a5 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.599705:0:5862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4afef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5837 expref: 16 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.599718:0:5862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4afef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5837 expref: 16 pid: 5861 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940486.599736:0:5862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5830a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5862:1875839738255360:192.168.202.14@tcp:104: 00000100:00100000:2.0:1788940486.599790:0:5862:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1865229c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788940486.615565:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940486.615762:0:5862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5830a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5862:1875839738255360:192.168.202.14@tcp:104: 00010000:00010000:2.0:1788940486.615794:0:5862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b0a5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940486.616268:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718305536 00000100:00100000:3.0:1788940486.616278:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718305536 00010000:00010000:3.0:1788940486.616321:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4afef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5837 expref: 17 pid: 5861 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940486.616358:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 46 00000100:00100000:3.0:1788940486.616369:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ba974700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+17:2352:x1875839718305536:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940486.616386:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940486.616394:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4afef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5837 expref: 17 pid: 5861 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940486.616407:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4afef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5837 expref: 17 pid: 5861 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940486.616428:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4afef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5837 expref: 17 pid: 5861 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940486.616456:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89f1983af100) 00010000:00010000:3.0:1788940486.616460:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b0a5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940486.616469:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b0a5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940486.617413:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b0a5 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940486.617708:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940486.617801:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ba974700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+16:2352:x1875839718305536:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 1429us (2241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940486.617812:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 46 00010000:00010000:0.0:1788940486.618166:0:5862:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b0a5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940486.618176:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b0a5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940486.618195:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b0a5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940486.618201:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b0a5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940486.618208:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b0a5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940486.618214:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188daa600 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:0.0:1788940486.618231:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b0a5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940486.618247:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b0a5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940486.618263:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89f1983af100) 00010000:00010000:0.0:1788940486.618266:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940486.618271:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b0a5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940486.618276:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b0a5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940486.618293:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3c00/0x27a633fcdd4b097 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940486.618299:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3c00/0x27a633fcdd4b097 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940486.618323:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3c00/0x27a633fcdd4b097 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940486.618328:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad3c00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:0.0:1788940486.618332:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3c00/0x27a633fcdd4b097 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940486.618338:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3c00/0x27a633fcdd4b097 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940486.618346:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89f1983af100) 00010000:00010000:0.0:1788940486.618348:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788940486.618352:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3c00/0x27a633fcdd4b097 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940486.618357:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3c00/0x27a633fcdd4b097 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940486.619216:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5834a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+15:10459:x1875839718305280:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 Request processed in 35645us (36031us total) trans 4294967360 rc 0/0 00000100:00100000:0.0:1788940486.620162:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 83 00000020:00080000:0.0:1788940486.620173:0:5862:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788940486.622218:0:11708:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788940486.622227:0:11708:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788940486.622279:0:11708:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788940486.622285:0:11708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788940486.647612:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940486.648443:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718305792 00000100:00100000:0.0:1788940486.648457:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718305792 00000100:00100000:0.0:1788940486.648578:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 20 00000100:00100000:0.0:1788940486.648591:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5830a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+15:10459:x1875839718305792:12345-192.168.202.14@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788940486.649245:0:5863:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788940486.649356:0:5863:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:0.0:1788940486.649415:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3c00/0x27a633fcdd4b0ac lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940486.649431:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3c00/0x27a633fcdd4b0ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940486.649443:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3c00/0x27a633fcdd4b0ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940486.649453:0:5863:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3c00/0x27a633fcdd4b0ac lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940486.649459:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3c00/0x27a633fcdd4b0ac lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940486.649466:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3c00/0x27a633fcdd4b0ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940486.649500:0:5863:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788940486.649632:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5830a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+17:10459:x1875839718305792:12345-192.168.202.14@tcp:35:lhsmtool_posix.0 Request processed in 1042us (2030us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1788940486.649641:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 20 00000020:00080000:0.0:1788940486.649647:0:5863:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788940486.651046:0:7649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940486.651063:0:7649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3c00/0x27a633fcdd4b0ac lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940486.651078:0:7649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad3c00 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:1.0:1788940486.651083:0:7649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3c00/0x27a633fcdd4b0ac lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940486.651094:0:7649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3c00/0x27a633fcdd4b0ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940486.651113:0:7649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff89f1983afe00) 00010000:00010000:1.0:1788940486.651116:0:7649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788940486.651122:0:7649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3c00/0x27a633fcdd4b0ac lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940486.651128:0:7649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3c00/0x27a633fcdd4b0ac lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940486.651159:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940486.651162:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940486.651163:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940486.655735:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940486.655772:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940486.655814:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940486.655938:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718306176 00000100:00100000:3.0:1788940486.655951:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718306176 00000100:00100000:3.0:1788940486.656037:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 155 00000100:00100000:3.0:1788940486.656049:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5833100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffa310cd-169f-42e3-8999-506116bada08+5:2353:x1875839718306176:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788940486.656133:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5833100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffa310cd-169f-42e3-8999-506116bada08+5:2353:x1875839718306176:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 86us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940486.656142:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 155 00000100:00100000:1.0:1788940486.656347:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718305920 00000100:00100000:1.0:1788940486.656352:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718305920 00000100:00100000:1.0:1788940486.656398:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 299 00000100:00100000:1.0:1788940486.656422:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:2353:x1875839718305920:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788940486.656453:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:2353:x1875839718305920:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 33us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940486.656460:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 299 00000100:00080000:2.0:1788940486.661052:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940486.677452:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718306048 00000100:00100000:1.0:1788940486.677472:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718306048 00000100:00100000:1.0:1788940486.677608:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 81 00000100:00100000:1.0:1788940486.677634:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5833800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+7:2353:x1875839718306048:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788940486.677730:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5833800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+7:2353:x1875839718306048:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 112us (21915us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940486.677737:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 81 00000100:00080000:3.0:1788940486.678332:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1788940486.730738:0:7662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00080000:3.0:1788940486.732085:0:7662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:0.0:1788940487.148907:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ba975880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875839738255872:0@lo:400:kworker.0 00000100:00100000:0.0:1788940487.148983:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940487.149042:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788940487.149047:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ba975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875839738255744:0@lo:400:kworker.0 00000100:00100000:0.0:1788940487.149065:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940487.149078:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ba974a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738256256:0@lo:400:kworker.0 00000100:00100000:0.0:1788940487.149101:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940487.149142:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738255872 00000100:00100000:0.0:1788940487.149150:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738255872 00000100:00100000:0.0:1788940487.149191:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738255744 00000100:00100000:0.0:1788940487.149193:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738255744 00000100:00100000:0.0:1788940487.149206:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788940487.149213:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ba977100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875839738255872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940487.149267:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ba977100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875839738255872:12345-0@lo:400:kworker.0 Request processed in 53us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940487.149275:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788940487.149314:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ba975880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875839738255872:0@lo:400:kworker.0 00000100:00100000:0.0:1788940487.149334:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788940487.149340:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ba977800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875839738255744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940487.149374:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ba977800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875839738255744:12345-0@lo:400:kworker.0 Request processed in 33us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940487.149379:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788940487.149401:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ba975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875839738255744:0@lo:400:kworker.0 00000100:00100000:3.0:1788940487.149545:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5837800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738255488:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788940487.149582:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940487.149613:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ba974000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738256000:0@lo:400:kworker.0 00000100:00100000:3.0:1788940487.149635:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940487.149662:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788940487.149668:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ba977480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3307:1875839738255616:0@lo:400:kworker.0 00000100:00100000:3.0:1788940487.149707:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940487.149726:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ba975c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875839738256128:0@lo:400:kworker.0 00000100:00100000:3.0:1788940487.149741:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940487.149762:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738256128 00000100:00100000:3.0:1788940487.149765:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738256128 00000100:00100000:3.0:1788940487.149783:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788940487.149787:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875839738256128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940487.149812:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875839738256128:12345-0@lo:400:kworker.0 Request processed in 25us (70us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940487.149816:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788940487.149831:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738256256 00000100:00100000:3.0:1788940487.149833:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738256256 00000100:00100000:3.0:1788940487.149849:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738256000 00000100:00100000:3.0:1788940487.149851:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738256000 00000100:00100000:3.0:1788940487.149864:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788940487.149868:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ba977b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738256256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940487.149889:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ba977b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738256256:12345-0@lo:400:kworker.0 Request processed in 21us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940487.149893:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788940487.149903:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788940487.149908:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1875839738256000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940487.149944:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1875839738256000:12345-0@lo:400:kworker.0 Request processed in 35us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940487.149950:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:3.0:1788940487.149969:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788940487.149974:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788940487.149994:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738255616 00000100:00100000:3.0:1788940487.150004:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738255616 00000100:00100000:3.0:1788940487.150028:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1788940487.150034:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3307:x1875839738255616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940487.150065:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3307:x1875839738255616:12345-0@lo:400:kworker.0 Request processed in 31us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940487.150071:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1788940487.150110:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ba977480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3307:1875839738255616:0@lo:400:kworker.0 00000100:00100000:3.0:1788940487.150121:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ba975c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875839738256128:0@lo:400:kworker.0 00000100:00100000:3.0:1788940487.150131:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ba974000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738256000:0@lo:400:kworker.0 00000100:00100000:3.0:1788940487.150154:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:3.0:1788940487.150158:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:3.0:1788940487.150169:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89f1bf581500, transno 4294967301 00000100:00100000:3.0:1788940487.150176:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ba974a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738256256:0@lo:400:kworker.0 00000100:00100000:1.0:1788940487.150244:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738255488 00000100:00100000:1.0:1788940487.150250:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738255488 00000100:00100000:1.0:1788940487.150288:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788940487.150296:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1901e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875839738255488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788940487.150313:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:1.0:1788940487.150343:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1901e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875839738255488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940487.150348:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788940487.150575:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5837800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738255488:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788940487.341205:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788940487.923587:0:12081:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788940487.923596:0:12081:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788940487.923635:0:12081:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788940487.923641:0:12081:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788940488.143832:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940488.144092:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718306432 00000100:00100000:3.0:1788940488.144106:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718306432 00000100:00100000:3.0:1788940488.144174:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 84 00000100:00100000:3.0:1788940488.144186:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5833b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+17:10478:x1875839718306432:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:3.0:1788940488.144213:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940488.144235:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b0b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f586f expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.144331:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031a00/0x27a633fcdd4b0ba lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.144352:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031a00/0x27a633fcdd4b0ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.144367:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031a00/0x27a633fcdd4b0ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940488.144380:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788940488.144547:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b0b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f586f expref: 20 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.144564:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031a00/0x27a633fcdd4b0ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f586f expref: 19 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.144572:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89f188f81300) 00010000:00010000:3.0:1788940488.144575:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788940488.144578:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f180031a00, rc 0) 00000100:00100000:3.0:1788940488.144644:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5833b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+19:10478:x1875839718306432:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 460us (821us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1788940488.144652:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 84 00000100:00080000:3.0:1788940488.144681:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940488.155735:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940488.155862:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718306560 00000100:00100000:3.0:1788940488.155874:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718306560 00000100:00100000:3.0:1788940488.156054:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 85 00000100:00100000:3.0:1788940488.156066:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+19:10478:x1875839718306560:12345-192.168.202.14@tcp:34:lfs.0 00010000:00010000:3.0:1788940488.156162:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b0c8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.156180:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b0c8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.156207:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b0c8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.156223:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b0cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.156231:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b0cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.156237:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b0cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.156492:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b0d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.156501:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b0d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.156507:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b0d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788940488.156573:0:7857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b0d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.156587:0:7857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b0c8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.156594:0:7857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b0c8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.156601:0:7857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b0c8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.156618:0:7857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f180031800 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940488.156623:0:7857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b0c8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.156631:0:7857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b0c8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.156644:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89f188f81300) 00010000:00010000:3.0:1788940488.156647:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940488.156653:0:7857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b0c8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.156660:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b0c8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.156675:0:7857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b0cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.156681:0:7857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b0cf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.156686:0:7857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b0cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.156691:0:7857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f180030000 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940488.156694:0:7857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b0cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.156700:0:7857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b0cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.156719:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff89f18a6cea00) 00010000:00010000:3.0:1788940488.156721:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940488.156724:0:7857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b0cf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.156730:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b0cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.156750:0:7857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b0d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.156756:0:7857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b0d6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.156760:0:7857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b0d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.156765:0:7857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f180031600 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940488.156767:0:7857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b0d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.156773:0:7857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b0d6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.156780:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89f18a6cee00) 00010000:00010000:3.0:1788940488.156782:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940488.156785:0:7857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b0d6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.156789:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b0d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940488.157040:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+19:10478:x1875839718306560:12345-192.168.202.14@tcp:34:lfs.0 Request processed in 973us (1316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940488.157049:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 85 00000100:00100000:0.0:1788940488.270361:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940488.270503:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718306816 00000100:00100000:3.0:1788940488.270551:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718306816 00000100:00100000:3.0:1788940488.270618:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 86 00000100:00100000:3.0:1788940488.270629:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ba975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+19:10481:x1875839718306816:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:3.0:1788940488.270655:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940488.270681:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b0dd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5876 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.270778:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b0e4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.270796:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b0e4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.270809:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b0e4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.270826:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b0eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.270834:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b0eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.270841:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b0eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.271137:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b0f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.271147:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b0f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.271155:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b0f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940488.271166:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788940488.271259:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b0e4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.271268:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b0e4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.271275:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b0e4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.271281:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f180030000 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940488.271285:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b0e4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.271293:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b0e4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.271305:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89f188f81300) 00010000:00010000:3.0:1788940488.271308:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940488.271315:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b0e4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.271322:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b0e4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.271347:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b0eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.271353:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b0eb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.271358:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b0eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.271363:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f180031800 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940488.271366:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b0eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.271371:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b0eb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.271378:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff89f18a6cee00) 00010000:00010000:3.0:1788940488.271380:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940488.271383:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b0eb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.271387:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b0eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.271430:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b0dd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5876 expref: 22 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.271446:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b0f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5876 expref: 21 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.271478:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89f18a6cea00) 00010000:00010000:3.0:1788940488.271480:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788940488.271483:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f180030c00, rc 0) 00000100:00100000:3.0:1788940488.271614:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ba975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+21:10481:x1875839718306816:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 986us (1262us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1788940488.271623:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 86 00000100:00100000:0.0:1788940488.279894:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940488.280002:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718306944 00000100:00100000:3.0:1788940488.280018:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718306944 00000100:00100000:3.0:1788940488.280087:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 87 00000100:00100000:3.0:1788940488.280099:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ba975880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+21:10481:x1875839718306944:12345-192.168.202.14@tcp:54:lfs.0 00010000:00010000:3.0:1788940488.280174:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b100 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.280192:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b100 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.280204:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b100 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.280233:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b100 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.280239:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b100 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.280247:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b100 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.280252:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f180031600 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940488.280272:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b100 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.280280:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b100 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.280293:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89f18a6cea00) 00010000:00010000:3.0:1788940488.280295:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788940488.280300:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b100 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.280306:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b100 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940488.280454:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ba975880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+21:10481:x1875839718306944:12345-192.168.202.14@tcp:54:lfs.0 Request processed in 356us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940488.280479:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 87 00000100:00100000:1.0:1788940488.290871:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940488.291087:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718307200 00000100:00100000:0.0:1788940488.291112:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718307200 00000100:00100000:0.0:1788940488.291187:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 21 00000100:00100000:0.0:1788940488.291198:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b0611c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+21:10481:x1875839718307200:12345-192.168.202.14@tcp:35:lfs.0 00000100:00100000:0.0:1788940488.291475:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b0611c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+22:10481:x1875839718307200:12345-192.168.202.14@tcp:35:lfs.0 Request processed in 277us (612us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1788940488.291484:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 21 00000100:00100000:2.0:1788940488.360921:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940488.361060:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718307456 00000100:00100000:3.0:1788940488.361075:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718307456 00000100:00100000:3.0:1788940488.361140:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 88 00000100:00100000:3.0:1788940488.361151:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+22:10000:x1875839718307456:12345-192.168.202.14@tcp:101:bash.0 00010000:00010000:3.0:1788940488.361182:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940488.361206:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b107 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f587d expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.361344:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b10e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.361358:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b0f2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5876 expref: 23 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.361385:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b10e lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.361420:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b0f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5876 expref: 23 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.361432:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b0f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5876 expref: 23 pid: 5861 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940488.361446:0:5861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bfbd9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5861:1875839738256384:192.168.202.14@tcp:104: 00000100:00100000:3.0:1788940488.361591:0:5861:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f190e430c0 going to sleep for 11 seconds 00010000:00010000:3.0:1788940488.364845:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940488.365091:0:5861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bfbd9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5861:1875839738256384:192.168.202.14@tcp:104: 00010000:00010000:3.0:1788940488.365123:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b10e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940488.374152:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940488.374269:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718307584 00000100:00100000:0.0:1788940488.374308:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718307584 00010000:00010000:0.0:1788940488.374356:0:8470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b0f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5876 expref: 24 pid: 5861 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940488.374404:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 47 00000100:00100000:0.0:1788940488.374415:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5832a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+24:2352:x1875839718307584:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940488.374431:0:8470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940488.374438:0:8470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b0f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5876 expref: 24 pid: 5861 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940488.374454:0:8470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b0f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5876 expref: 24 pid: 5861 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940488.374515:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b0f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5876 expref: 24 pid: 5861 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940488.374562:0:8470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89f18a6cea00) 00010000:00010000:0.0:1788940488.374567:0:8470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b10e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940488.374576:0:8470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b10e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940488.374583:0:8470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b10e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940488.374615:0:8470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940488.374681:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5832a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+23:2352:x1875839718307584:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 267us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940488.374698:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 47 00010000:00010000:3.0:1788940488.374881:0:5861:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b10e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.374890:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b10e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940488.374909:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788940488.375059:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b107 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f587d expref: 24 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.375076:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b10e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f587d expref: 23 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.375090:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89f18a6cea00) 00010000:00010000:3.0:1788940488.375093:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788940488.375096:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f180031800, rc 0) 00000100:00100000:3.0:1788940488.375125:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+23:10000:x1875839718307456:12345-192.168.202.14@tcp:101:bash.0 Request processed in 13975us (14214us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1788940488.375132:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 88 00000100:00100000:1.0:1788940488.389382:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940488.389593:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718307840 00000100:00100000:3.0:1788940488.389606:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718307840 00000100:00100000:3.0:1788940488.389674:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 89 00000100:00100000:3.0:1788940488.389687:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+23:10000:x1875839718307840:12345-192.168.202.14@tcp:36:bash.0 00010000:00010000:3.0:1788940488.389979:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b11c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.389997:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b11c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.390009:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b11c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788940488.390063:0:5862:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:3.0:1788940488.390092:0:5862:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000668a37f3 reply state 00000000a86d4d21 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b11c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940488.390102:0:5862:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1788940488.390151:0:5862:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:3.0:1788940488.390270:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+27:10000:x1875839718307840:12345-192.168.202.14@tcp:36:bash.0 Request processed in 584us (898us total) trans 4294967369 rc 0/0 00000100:00100000:3.0:1788940488.390277:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 89 00000020:00080000:3.0:1788940488.390310:0:5862:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1788940488.398834:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940488.399142:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718307968 00000100:00100000:0.0:1788940488.399157:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718307968 00000100:00100000:0.0:1788940488.399241:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 90 00000100:00100000:0.0:1788940488.399255:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+27:10000:x1875839718307968:12345-192.168.202.14@tcp:101:bash.0 00010000:00010000:0.0:1788940488.399290:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940488.399329:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3200/0x27a633fcdd4b123 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5884 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940488.399395:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3200/0x27a633fcdd4b123 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5884 expref: 28 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940488.399410:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3200/0x27a633fcdd4b123 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5884 expref: 28 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940488.399433:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89f18a6cea00) 00010000:00010000:0.0:1788940488.399437:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788940488.399441:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f082ad3200, rc 0) 00000100:00100000:0.0:1788940488.399557:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+28:10000:x1875839718307968:12345-192.168.202.14@tcp:101:bash.0 Request processed in 305us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940488.399564:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 90 00010000:00010000:3.0:1788940488.406955:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b11c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.406974:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b11c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.406983:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b11c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.406989:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f180031600 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940488.406993:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b11c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.407001:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b11c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.407019:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89f18a6cea00) 00010000:00010000:3.0:1788940488.407023:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940488.407028:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b11c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.407035:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b11c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940488.417306:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940488.417475:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718308096 00000100:00100000:3.0:1788940488.417490:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718308096 00000100:00100000:3.0:1788940488.417621:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 33 00000100:00100000:3.0:1788940488.417635:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5830e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:10000:x1875839718308096:12345-192.168.202.14@tcp:101:bash.0 00010000:00010000:3.0:1788940488.417660:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940488.417686:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cfe34ce/0x27a633fcdd4b12a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f588b expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788940488.417741:0:6705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa110c5, atime: 0x6aa110c2, ctime: 0x6aa110c5, blocks: 0xb 00010000:00010000:3.0:1788940488.417775:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=431s v=(0 0) 00010000:00010000:3.0:1788940488.417780:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940488.417791:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cfe34ce/0x27a633fcdd4b12a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f588b expref: 7 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.417813:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002cfe34ce/0x27a633fcdd4b12a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f588b expref: 7 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.417828:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f180031600, rc 0) 00000100:00100000:3.0:1788940488.417908:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5830e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+7:10000:x1875839718308096:12345-192.168.202.14@tcp:101:bash.0 Request processed in 277us (625us total) trans 0 rc 0/0 00000100:00080000:0.0:1788940488.418096:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788940488.418144:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 33 00000100:00100000:2.0:1788940488.431729:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940488.431879:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718308224 00000100:00100000:1.0:1788940488.431892:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718308224 00002000:00010000:1.0:1788940488.431965:0:6711:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:1.0:1788940488.431971:0:6711:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89f1b5832680 with x1875839718308224 ext(0->18446744073709551615) 00002000:00010000:1.0:1788940488.431984:0:6711:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89f1b5832680. 00000100:00100000:1.0:1788940488.432021:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 1 00000100:00100000:1.0:1788940488.432033:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5832680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+7:2353:x1875839718308224:12345-192.168.202.14@tcp:10:bash.0 00002000:00010000:1.0:1788940488.432389:0:6711:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1788940488.432395:0:6711:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788940485 -> 1788940489 00002000:00010000:1.0:1788940488.432397:0:6711:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1788940482 -> 1788940482 00002000:00010000:1.0:1788940488.432400:0:6711:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788940485 -> 1788940489 00002000:00010000:1.0:1788940488.432402:0:6711:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1788940488.432740:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5832680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+8:2353:x1875839718308224:12345-192.168.202.14@tcp:10:bash.0 Request processed in 707us (1021us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788940488.432751:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 1 00002000:00010000:1.0:1788940488.432755:0:6711:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:1.0:1788940488.432758:0:6711:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89f1b5832680 with x1875839718308224 ext(0->18446744073709551615) 00002000:00010000:1.0:1788940488.432765:0:6711:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89f1b5832680. 00000100:00100000:2.0:1788940488.519715:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940488.519923:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718308352 00000100:00100000:3.0:1788940488.519937:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718308352 00000100:00100000:3.0:1788940488.520002:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 91 00000100:00100000:3.0:1788940488.520012:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+27:10495:x1875839718308352:12345-192.168.202.14@tcp:34:lfs.0 00010000:00010000:3.0:1788940488.520094:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b131 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.520126:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b131 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.520139:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b131 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.520179:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b138 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.520188:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b138 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.520195:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b138 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.520446:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b13f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.520470:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b13f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.520477:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b13f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788940488.520561:0:5862:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b13f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.520575:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b131 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.520581:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b131 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.520588:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b131 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.520594:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f180030000 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940488.520599:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b131 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.520613:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b131 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.520627:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89f188f81300) 00010000:00010000:3.0:1788940488.520630:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940488.520636:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b131 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.520642:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b131 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.520657:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b138 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.520662:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b138 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.520667:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b138 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.520672:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f180030c00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940488.520674:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b138 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.520680:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b138 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.520687:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff89f18a6ce400) 00010000:00010000:3.0:1788940488.520689:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940488.520692:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b138 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.520711:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b138 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.520726:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b13f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.520733:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b13f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.520739:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b13f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.520744:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f180030400 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940488.520747:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b13f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.520753:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b13f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.520761:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89f18a6cea00) 00010000:00010000:3.0:1788940488.520763:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940488.520766:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b13f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.520771:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b13f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940488.520871:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+27:10495:x1875839718308352:12345-192.168.202.14@tcp:34:lfs.0 Request processed in 858us (1167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940488.520879:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 91 00000100:00100000:0.0:1788940488.571187:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940488.571307:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718308608 00000100:00100000:3.0:1788940488.571341:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718308608 00000100:00100000:3.0:1788940488.571434:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 92 00000100:00100000:3.0:1788940488.571448:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ba974a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+27:10498:x1875839718308608:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:3.0:1788940488.571493:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940488.571555:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b146 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5892 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.571653:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b14d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.571672:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b14d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.571686:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b14d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.571703:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b154 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.571711:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b154 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.571717:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b154 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.572068:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b15b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.572080:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b15b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.572088:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b15b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940488.572105:0:5860:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788940488.572218:0:5860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b14d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.572227:0:5860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b14d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.572235:0:5860:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b14d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.572242:0:5860:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f180030c00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940488.572247:0:5860:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b14d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.572254:0:5860:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b14d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.572266:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89f188f81300) 00010000:00010000:3.0:1788940488.572268:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940488.572273:0:5860:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b14d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.572278:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b14d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.572289:0:5860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b154 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.572292:0:5860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b154 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.572296:0:5860:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b154 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.572304:0:5860:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f180030000 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940488.572306:0:5860:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b154 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.572310:0:5860:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b154 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.572314:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff89f18a6ce400) 00010000:00010000:3.0:1788940488.572315:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940488.572317:0:5860:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b154 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.572320:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b154 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.572364:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b146 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5892 expref: 30 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.572376:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b15b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5892 expref: 29 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.572381:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89f18a6cea00) 00010000:00010000:3.0:1788940488.572383:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788940488.572385:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f180030a00, rc 0) 00000100:00100000:3.0:1788940488.572485:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ba974a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+29:10498:x1875839718308608:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 1039us (1307us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1788940488.572494:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 92 00000100:00100000:2.0:1788940488.583851:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940488.587081:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718308736 00000100:00100000:3.0:1788940488.587127:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718308736 00000100:00100000:3.0:1788940488.587200:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 93 00000100:00100000:3.0:1788940488.587268:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+29:10498:x1875839718308736:12345-192.168.202.14@tcp:54:lfs.0 00010000:00010000:1.0:1788940488.588771:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4b169 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940488.588808:0:5862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b10e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f587d expref: 29 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940488.588819:0:5862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4b169 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940488.588888:0:5862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b10e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f587d expref: 29 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940488.589102:0:5862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b10e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f587d expref: 29 pid: 5861 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940488.589122:0:5862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5837480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5862:1875839738256512:192.168.202.14@tcp:104: 00000100:00100000:1.0:1788940488.589716:0:5862:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f187ff6180 going to sleep for 11 seconds 00000100:00100000:2.0:1788940488.597665:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940488.597830:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718308992 00000100:00100000:3.0:1788940488.597845:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718308992 00000100:00100000:3.0:1788940488.597920:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 22 00000100:00100000:3.0:1788940488.597933:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+30:5596:x1875839718308992:12345-192.168.202.14@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788940488.598404:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+31:5596:x1875839718308992:12345-192.168.202.14@tcp:35:ldlm_bl.0 Request processed in 470us (753us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1788940488.598413:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 22 00000100:00100000:1.0:1788940488.598852:0:5862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5837480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5862:1875839738256512:192.168.202.14@tcp:104: 00010000:00010000:1.0:1788940488.598900:0:5862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4b169 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940488.613595:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940488.614113:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718309120 00000100:00100000:1.0:1788940488.614126:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718309120 00010000:00010000:1.0:1788940488.614180:0:5845:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b10e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f587d expref: 31 pid: 5861 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940488.614281:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 48 00000100:00100000:1.0:1788940488.614292:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ba974000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+31:2352:x1875839718309120:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788940488.614312:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940488.614321:0:5845:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b10e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f587d expref: 31 pid: 5861 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940488.614337:0:5845:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b10e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f587d expref: 31 pid: 5861 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940488.614364:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b10e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f587d expref: 31 pid: 5861 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940488.614417:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89f18a6cea00) 00010000:00010000:1.0:1788940488.614424:0:5845:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4b169 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940488.614436:0:5845:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4b169 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940488.614446:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4b169 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940488.614499:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940488.614614:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ba974000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+30:2352:x1875839718309120:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 323us (1037us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940488.614622:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 48 00010000:00010000:0.0:1788940488.618074:0:5862:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4b169 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940488.618127:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4b169 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940488.618175:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4b169 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940488.618185:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4b169 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940488.618193:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4b169 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940488.618200:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258dc00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:0.0:1788940488.618205:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4b169 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940488.618224:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4b169 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940488.618246:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89f18a6cea00) 00010000:00010000:0.0:1788940488.618249:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788940488.618257:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4b169 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940488.618264:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4b169 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940488.618437:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+29:10498:x1875839718308736:12345-192.168.202.14@tcp:54:lfs.0 Request processed in 31220us (34608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940488.618449:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 93 00000100:00100000:2.0:1788940488.626462:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940488.626767:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718309376 00000100:00100000:3.0:1788940488.626782:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718309376 00000100:00100000:3.0:1788940488.626904:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 23 00000100:00100000:3.0:1788940488.626927:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5830700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+29:10498:x1875839718309376:12345-192.168.202.14@tcp:35:lfs.0 00000100:00100000:3.0:1788940488.627322:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5830700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+30:10498:x1875839718309376:12345-192.168.202.14@tcp:35:lfs.0 Request processed in 398us (889us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1788940488.627331:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 23 00000100:00100000:0.0:1788940488.686243:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788940488.686309:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738256640:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788940488.686411:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940488.686929:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738256640 00000100:00100000:1.0:1788940488.686940:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738256640 00000100:00100000:1.0:1788940488.687019:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788940488.687031:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ba975c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738256640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788940488.687085:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788940488.687166:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ba975c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738256640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 137us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940488.687174:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788940488.687553:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738256640:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788940488.743903:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940488.744101:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718309632 00000100:00100000:1.0:1788940488.744113:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718309632 00000100:00100000:1.0:1788940488.744184:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 94 00000100:00100000:1.0:1788940488.744197:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ba977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+30:10509:x1875839718309632:12345-192.168.202.14@tcp:101:cat.0 00010000:00010000:1.0:1788940488.744240:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940488.744291:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4b170 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5899 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940488.744381:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b177 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940488.744399:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b177 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940488.744720:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b177 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940488.744745:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4b17e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940488.744753:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4b17e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940488.744760:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4b17e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940488.745771:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258cc00/0x27a633fcdd4b185 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940488.745789:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258cc00/0x27a633fcdd4b185 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940488.745800:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258cc00/0x27a633fcdd4b185 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940488.745815:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1788940488.745980:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b177 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940488.746184:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b177 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940488.746191:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b177 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940488.746198:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258c400 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940488.746203:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b177 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940488.746393:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b177 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940488.746563:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89f188f81300) 00010000:00010000:1.0:1788940488.746568:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940488.746574:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b177 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940488.746583:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b177 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940488.746601:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4b17e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940488.746607:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4b17e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940488.746614:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4b17e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940488.746619:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258dc00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940488.746631:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4b17e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940488.746638:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4b17e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940488.746647:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff89f188f81400) 00010000:00010000:1.0:1788940488.746649:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940488.746652:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4b17e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940488.746658:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4b17e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940488.746735:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4b170 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5899 expref: 33 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940488.746751:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258cc00/0x27a633fcdd4b185 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5899 expref: 32 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940488.746758:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89f18a6cea00) 00010000:00010000:1.0:1788940488.746761:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788940488.746764:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f19258cc00, rc 0) 00000100:00100000:1.0:1788940488.747152:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ba977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+32:10509:x1875839718309632:12345-192.168.202.14@tcp:101:cat.0 Request processed in 2955us (3263us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1788940488.747164:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 94 00000100:00100000:2.0:1788940488.756076:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940488.756180:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718309888 00000100:00100000:0.0:1788940488.756193:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718309888 00000100:00100000:0.0:1788940488.756283:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 24 00000100:00100000:0.0:1788940488.756296:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+32:10509:x1875839718309888:12345-192.168.202.14@tcp:35:cat.0 00000100:00100000:0.0:1788940488.757846:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+33:10509:x1875839718309888:12345-192.168.202.14@tcp:35:cat.0 Request processed in 915us (1320us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1788940488.757861:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 24 00000100:00100000:2.0:1788940488.783180:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940488.783282:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718310144 00000100:00100000:0.0:1788940488.783295:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718310144 00000100:00100000:0.0:1788940488.783372:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 95 00000100:00100000:0.0:1788940488.783384:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5830a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+33:10510:x1875839718310144:12345-192.168.202.14@tcp:36:rm.0 00010000:00010000:0.0:1788940488.783496:0:7857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788940488.783566:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258cc00/0x27a633fcdd4b185 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5899 expref: 33 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940488.783595:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b15b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5892 expref: 32 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940488.783610:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3200/0x27a633fcdd4b123 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5884 expref: 31 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940488.783621:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89f18a6cea00) 00010000:00010000:0.0:1788940488.783653:0:7857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788940488.783683:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3c00/0x27a633fcdd4b193 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940488.783699:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3c00/0x27a633fcdd4b193 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940488.783712:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3c00/0x27a633fcdd4b193 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940488.783729:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4b19a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940488.783736:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4b19a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940488.783743:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4b19a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940488.784741:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b1a1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940488.784760:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b1a1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940488.784770:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b1a1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788940488.785710:0:7857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:0.0:1788940488.785726:0:7857:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 431684206868ns, next at 432684203334ns, rc = 0 00010000:00010000:0.0:1788940488.785838:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b1a8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940488.785871:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b1a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940488.785885:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b1a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940488.785896:0:7857:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b1a8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940488.785903:0:7857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b1a8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940488.785921:0:7857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b1a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940488.785956:0:7857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788940488.785990:0:7857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b1a1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940488.785998:0:7857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b1a1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940488.786004:0:7857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b1a1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940488.786010:0:7857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad3800 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:0.0:1788940488.786015:0:7857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b1a1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940488.786024:0:7857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b1a1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940488.786050:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89f1983afa00) 00010000:00010000:0.0:1788940488.786053:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788940488.786060:0:7857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b1a1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940488.786067:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b1a1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940488.786095:0:7857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3c00/0x27a633fcdd4b193 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940488.786102:0:7857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3c00/0x27a633fcdd4b193 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940488.786108:0:7857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3c00/0x27a633fcdd4b193 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940488.786114:0:7857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad3c00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:0.0:1788940488.786117:0:7857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3c00/0x27a633fcdd4b193 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940488.786124:0:7857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3c00/0x27a633fcdd4b193 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940488.786134:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89f188f81300) 00010000:00010000:0.0:1788940488.786137:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940488.786140:0:7857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3c00/0x27a633fcdd4b193 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940488.786146:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3c00/0x27a633fcdd4b193 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788940488.786171:0:7857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003bbfddcd reply state 00000000677cdbb1 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4b19a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940488.786182:0:7857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788940488.786426:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940488.786434:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b1a8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.786441:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad2000 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:3.0:1788940488.786444:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b1a8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.786451:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b1a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.786484:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89f1983afa00) 00010000:00010000:3.0:1788940488.786487:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788940488.786491:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b1a8 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.786496:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b1a8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.786546:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940488.786549:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940488.786551:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940488.787676:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5830a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+32:10510:x1875839718310144:12345-192.168.202.14@tcp:36:rm.0 Request processed in 4280us (4500us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1788940488.787690:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 95 00010000:00010000:3.0:1788940488.791979:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4b19a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.792004:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4b19a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.792012:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4b19a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.792019:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad2e00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940488.792025:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4b19a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.792035:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4b19a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.792057:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff89f1983af100) 00010000:00010000:3.0:1788940488.792060:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940488.792067:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4b19a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.792097:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4b19a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940488.859751:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940488.859879:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718310400 00000100:00100000:3.0:1788940488.859892:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718310400 00000100:00100000:3.0:1788940488.859973:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 96 00000100:00100000:3.0:1788940488.859985:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+31:10516:x1875839718310400:12345-192.168.202.14@tcp:101:bash.0 00010000:00010000:3.0:1788940488.860019:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940488.860046:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b1af lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f58a0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.860232:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b1b6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.860252:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b1b6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.860267:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b1b6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.860287:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b1bd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.860296:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b1bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.860302:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b1bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788940488.861222:0:5860:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1788940488.861487:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b1c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.861502:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b1c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.861512:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b1c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.861595:0:5860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b1b6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.861604:0:5860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b1b6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.861613:0:5860:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b1b6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.861620:0:5860:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f180030000 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940488.861626:0:5860:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b1b6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.861635:0:5860:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b1b6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.861648:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89f188f81300) 00010000:00010000:3.0:1788940488.861652:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940488.861658:0:5860:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b1b6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.861664:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b1b6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788940488.861692:0:5860:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000262f2f0d reply state 0000000070564562 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b1bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940488.861702:0:5860:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788940488.861744:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b1af lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58a0 expref: 34 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.861759:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b1c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58a0 expref: 33 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.861767:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89f18a6cec00) 00010000:00010000:3.0:1788940488.861769:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788940488.861771:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f180030a00, rc 0) 00000100:00100000:3.0:1788940488.861879:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+34:10516:x1875839718310400:12345-192.168.202.14@tcp:101:bash.0 Request processed in 1895us (2145us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1788940488.861889:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 96 00000100:00100000:2.0:1788940488.866229:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940488.866692:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718310528 00000100:00100000:0.0:1788940488.866707:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718310528 00000100:00100000:0.0:1788940488.866805:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 34 00000100:00100000:0.0:1788940488.866817:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bff62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+5:2353:x1875839718310528:12345-192.168.202.14@tcp:101:bash.0 00010000:00010000:0.0:1788940488.866846:0:6707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940488.866877:0:6707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c74d2b5e/0x27a633fcdd4b1d2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f58a7 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788940488.866923:0:6707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788940488.866954:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=431s v=(0 0) 00010000:00010000:0.0:1788940488.866961:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940488.866975:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c74d2b5e/0x27a633fcdd4b1d2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58a7 expref: 6 pid: 6707 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940488.867001:0:6707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c74d2b5e/0x27a633fcdd4b1d2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58a7 expref: 6 pid: 6707 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940488.867015:0:6707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f082ad3c00, rc 0) 00000100:00100000:0.0:1788940488.867093:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bff62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2353:x1875839718310528:12345-192.168.202.14@tcp:101:bash.0 Request processed in 278us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940488.867113:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 34 00000100:00080000:2.0:1788940488.868637:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788940488.870490:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b1bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.870514:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b1bd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.870541:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b1bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.870548:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f180030c00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940488.870554:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b1bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.870589:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b1bd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.870614:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff89f18a6ce400) 00010000:00010000:3.0:1788940488.870617:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940488.870624:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b1bd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.870632:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b1bd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940488.870966:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940488.871066:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718310656 00000100:00100000:3.0:1788940488.871080:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718310656 00000100:00100000:3.0:1788940488.871221:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 35 00000100:00100000:3.0:1788940488.871234:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bff62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:10516:x1875839718310656:12345-192.168.202.14@tcp:101:bash.0 00010000:00010000:3.0:1788940488.871262:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940488.871287:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096a8ebe7/0x27a633fcdd4b1d9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f58ae expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.871330:0:6705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c74d2b5e/0x27a633fcdd4b1d2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58a7 expref: 7 pid: 6707 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.871343:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940488.871348:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940488.871355:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096a8ebe7/0x27a633fcdd4b1d9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58ae expref: 7 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.871400:0:6705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c74d2b5e/0x27a633fcdd4b1d2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58a7 expref: 7 pid: 6707 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.871490:0:6705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c74d2b5e/0x27a633fcdd4b1d2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58a7 expref: 7 pid: 6707 timeout: 531 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940488.871508:0:6705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bfbd9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6705:1875839738256768:192.168.202.14@tcp:104: 00000100:00100000:3.0:1788940488.871682:0:6705:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f190e43300 going to sleep for 11 seconds 00000100:00100000:0.0:1788940488.874835:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940488.874954:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718310784 00000100:00100000:2.0:1788940488.874966:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718310784 00010000:00010000:2.0:1788940488.875020:0:8470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c74d2b5e/0x27a633fcdd4b1d2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58a7 expref: 8 pid: 6707 timeout: 531 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940488.875076:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 49 00000100:00100000:2.0:1788940488.875088:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1841b5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+8:2352:x1875839718310784:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788940488.875107:0:8470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940488.875139:0:8470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c74d2b5e/0x27a633fcdd4b1d2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58a7 expref: 8 pid: 6707 timeout: 531 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940488.875157:0:8470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c74d2b5e/0x27a633fcdd4b1d2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58a7 expref: 8 pid: 6707 timeout: 531 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940488.875191:0:8470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940488.875196:0:8470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940488.875207:0:8470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000096a8ebe7/0x27a633fcdd4b1d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58ae expref: 8 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940488.875238:0:8470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096a8ebe7/0x27a633fcdd4b1d9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58ae expref: 8 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940488.875290:0:8470:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000096a8ebe7/0x27a633fcdd4b1d9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58ae expref: 8 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940488.875307:0:8470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bff62300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8470:1875839738256896:192.168.202.14@tcp:105: 00010000:00010000:3.0:1788940488.875727:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c74d2b5e/0x27a633fcdd4b1d2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58a7 expref: 8 pid: 6707 timeout: 531 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940488.875747:0:6705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bfbd9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6705:1875839738256768:192.168.202.14@tcp:104: 00010000:00010000:3.0:1788940488.875778:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000096a8ebe7/0x27a633fcdd4b1d9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58ae expref: 7 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940488.875790:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f180031800, rc 0) 00000100:00100000:3.0:1788940488.875826:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bff62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+7:10516:x1875839718310656:12345-192.168.202.14@tcp:101:bash.0 Request processed in 4595us (4927us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940488.875835:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 35 00000100:00100000:2.0:1788940488.875907:0:8470:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f19860d240 going to sleep for 11 seconds 00000100:00100000:2.0:1788940488.881106:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940488.881189:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718311040 00000100:00100000:3.0:1788940488.881202:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718311040 00000100:00100000:3.0:1788940488.881290:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 25 00000100:00100000:3.0:1788940488.881301:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bff60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+33:10516:x1875839718311040:12345-192.168.202.14@tcp:35:bash.0 00000001:00080000:3.0:1788940488.881740:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967377 00000100:00100000:3.0:1788940488.881863:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bff60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+35:10516:x1875839718311040:12345-192.168.202.14@tcp:35:bash.0 Request processed in 562us (775us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1788940488.881894:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 25 00000020:00080000:3.0:1788940488.881900:0:5864:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788940488.883860:0:8470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bff62300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8470:1875839738256896:192.168.202.14@tcp:105: 00010000:00010000:0.0:1788940488.883894:0:8470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940488.883981:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1841b5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2352:x1875839718310784:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 8894us (9167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940488.883994:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 49 00000100:00100000:2.0:1788940489.054392:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940489.054648:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718311168 00000100:00100000:1.0:1788940489.054662:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718311168 00000100:00100000:1.0:1788940489.054766:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 97 00000100:00100000:1.0:1788940489.054785:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bff62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+35:10532:x1875839718311168:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:1.0:1788940489.054859:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940489.054893:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4b1e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f58b5 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.055003:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4b1e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.055021:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4b1e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.055036:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4b1e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940489.055154:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788940489.055159:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788940489.055197:0:5862:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4b1e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.055433:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4b1e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58b5 expref: 37 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.055471:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4b1e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58b5 expref: 36 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.055481:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89f188f81300) 00010000:00010000:1.0:1788940489.055484:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788940489.055489:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f19258dc00, rc 0) 00000100:00100000:1.0:1788940489.056291:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bff62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+36:10532:x1875839718311168:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 1427us (1839us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940489.056667:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 97 00000100:00100000:2.0:1788940489.062659:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940489.062815:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718311424 00000100:00100000:3.0:1788940489.062831:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718311424 00000100:00100000:3.0:1788940489.062906:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 98 00000100:00100000:3.0:1788940489.062918:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bff60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+36:10532:x1875839718311424:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:3.0:1788940489.062948:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940489.062979:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b1ee lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f58bc expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.063127:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b1f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.063145:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b1f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.063160:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b1f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940489.063173:0:5860:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788940489.063412:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b1ee lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58bc expref: 39 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.063435:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b1f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58bc expref: 38 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.063445:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89f18a6cec00) 00010000:00010000:3.0:1788940489.063448:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788940489.063490:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f180030400, rc 0) 00000100:00100000:3.0:1788940489.063863:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bff60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+38:10532:x1875839718311424:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 945us (1219us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1788940489.063874:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 98 00000100:00100000:0.0:1788940489.070774:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940489.070830:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940489.070870:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718311680 00000100:00100000:3.0:1788940489.070884:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718311680 00000100:00100000:3.0:1788940489.070958:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 99 00000100:00100000:3.0:1788940489.070970:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ba975500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+38:10532:x1875839718311680:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:3.0:1788940489.071004:0:7857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940489.071042:0:7857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b203 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f58c3 expref: -99 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.071187:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829da800/0x27a633fcdd4b20a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.071206:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829da800/0x27a633fcdd4b20a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.071229:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829da800/0x27a633fcdd4b20a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940489.071246:0:7857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788940489.071437:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b203 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58c3 expref: 41 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.071468:0:7857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829da800/0x27a633fcdd4b20a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58c3 expref: 40 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.071477:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89f18a6cec00) 00000100:00100000:2.0:1788940489.072690:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718311808 00000100:00100000:2.0:1788940489.072706:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718311808 00000100:00100000:2.0:1788940489.072839:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 6 00000100:00100000:2.0:1788940489.072851:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ba974700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+41:2352:x1875839718311808:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788940489.072869:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940489.072941:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788940489.072948:0:7857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f1829da800, rc 0) 00000100:00100000:3.0:1788940489.073052:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ba975500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+41:10532:x1875839718311680:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 2084us (2292us total) trans 4294967380 rc 0/0 00000100:00100000:3.0:1788940489.073059:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 99 00010000:00010000:2.0:1788940489.078332:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b1f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58bc expref: 40 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940489.078369:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89f18a6cec00) 00010000:00010000:2.0:1788940489.078376:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940489.079393:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ba974700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+39:2352:x1875839718311808:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 6535us (8552us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940489.081511:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 6 00000100:00100000:0.0:1788940489.083897:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940489.084120:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718311936 00000100:00100000:1.0:1788940489.084134:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718311936 00000100:00100000:1.0:1788940489.084214:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 36 00000100:00100000:1.0:1788940489.084234:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ba974000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2350:x1875839718311936:12345-192.168.202.14@tcp:1:lfs.0 00010000:00010000:1.0:1788940489.084312:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d70aacaf/0x27a633fcdd4b218 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.084346:0:6707:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000096a8ebe7/0x27a633fcdd4b1d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58ae expref: 6 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.084357:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940489.084362:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788940489.084368:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d70aacaf/0x27a633fcdd4b218 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.084427:0:6707:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000096a8ebe7/0x27a633fcdd4b1d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58ae expref: 6 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.084460:0:6707:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000096a8ebe7/0x27a633fcdd4b1d9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58ae expref: 6 pid: 6705 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940489.084479:0:6707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5834380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6707:1875839738257024:192.168.202.14@tcp:104: 00000100:00100000:1.0:1788940489.084624:0:6707:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f191e3bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788940489.089226:0:6707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5834380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6707:1875839738257024:192.168.202.14@tcp:104: 00010000:00010000:1.0:1788940489.089276:0:6707:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d70aacaf/0x27a633fcdd4b218 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940489.090426:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940489.090627:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718312064 00000100:00100000:1.0:1788940489.090637:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718312064 00002000:00100000:1.0:1788940489.090701:0:6712:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff89f1ba975180 x1875839718312064/t0(0) o4->9c51ff78-d02d-4e61-8a10-a2f8830f1679@192.168.202.14@tcp:465/0 lens 504/0 e 0 to 0 dl 1788940500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788940489.090714:0:6712:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89f1ba975180 with x1875839718312064 ext(0->8) 00010000:00010000:1.0:1788940489.090724:0:6712:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000096a8ebe7/0x27a633fcdd4b1d9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58ae expref: 7 pid: 6705 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.090744:0:6712:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000096a8ebe7/0x27a633fcdd4b1d9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58ae expref: 7 pid: 6705 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788940489.090753:0:6712:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff89f1ba975180 00000100:00100000:1.0:1788940489.090796:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 1 00000100:00100000:1.0:1788940489.090807:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ba975180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+7:2353:x1875839718312064:12345-192.168.202.14@tcp:4:lfs.0 00000100:00100000:1.0:1788940489.092941:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ba975180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+9:2353:x1875839718312064:12345-192.168.202.14@tcp:4:lfs.0 Request processed in 2120us (2518us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788940489.092958:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 1 00002000:00100000:1.0:1788940489.092972:0:6712:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff89f1ba975180 x1875839718312064/t4294967302(0) o4->9c51ff78-d02d-4e61-8a10-a2f8830f1679@192.168.202.14@tcp:465/0 lens 504/448 e 0 to 0 dl 1788940500 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788940489.092984:0:6712:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89f1ba975180 with x1875839718312064 ext(0->8) 00010000:00010000:1.0:1788940489.092997:0:6712:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000096a8ebe7/0x27a633fcdd4b1d9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58ae expref: 9 pid: 6705 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.093117:0:6712:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000096a8ebe7/0x27a633fcdd4b1d9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58ae expref: 9 pid: 6705 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788940489.093126:0:6712:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff89f1ba975180 00000100:00100000:0.0:1788940489.096550:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940489.096894:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718312192 00000100:00100000:1.0:1788940489.096916:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718312192 00010000:00010000:1.0:1788940489.096971:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000096a8ebe7/0x27a633fcdd4b1d9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58ae expref: 9 pid: 6705 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940489.097030:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 50 00000100:00100000:1.0:1788940489.097041:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ba976a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+9:2351:x1875839718312192:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788940489.097060:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788940489.097087:0:5847:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788940489.097091:0:5847:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788940490 00002000:00010000:1.0:1788940489.097094:0:5847:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788940490 00002000:00010000:1.0:1788940489.097096:0:5847:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788940490 00010000:00010000:1.0:1788940489.097103:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000096a8ebe7/0x27a633fcdd4b1d9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58ae expref: 9 pid: 6705 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.097119:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000096a8ebe7/0x27a633fcdd4b1d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58ae expref: 9 pid: 6705 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.097149:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096a8ebe7/0x27a633fcdd4b1d9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58ae expref: 9 pid: 6705 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.097192:0:5847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788940489.097198:0:5847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788940489.097204:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d70aacaf/0x27a633fcdd4b218 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.097226:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d70aacaf/0x27a633fcdd4b218 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.097270:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788940489.097414:0:6707:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d70aacaf/0x27a633fcdd4b218 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940489.097425:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d70aacaf/0x27a633fcdd4b218 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940489.097465:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d70aacaf/0x27a633fcdd4b218 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940489.097474:0:6707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d70aacaf/0x27a633fcdd4b218 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940489.097491:0:6707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d70aacaf/0x27a633fcdd4b218 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940489.097500:0:6707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258c600 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:2.0:1788940489.097505:0:6707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d70aacaf/0x27a633fcdd4b218 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940489.097541:0:6707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d70aacaf/0x27a633fcdd4b218 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940489.097557:0:6707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d70aacaf/0x27a633fcdd4b218 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940489.097565:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d70aacaf/0x27a633fcdd4b218 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940489.098225:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ba976a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+8:2351:x1875839718312192:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 1179us (1708us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940489.098238:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 50 00000100:00100000:2.0:1788940489.099054:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ba974000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+7:2350:x1875839718311936:12345-192.168.202.14@tcp:1:lfs.0 Request processed in 14817us (15169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940489.099069:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 36 00000100:00100000:3.0:1788940489.104280:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940489.104363:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718312448 00000100:00100000:0.0:1788940489.104375:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718312448 00000100:00100000:0.0:1788940489.104459:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 26 00000100:00100000:0.0:1788940489.104472:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b0610050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+39:10532:x1875839718312448:12345-192.168.202.14@tcp:35:lfs.0 00000004:00010000:0.0:1788940489.104582:0:5864:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829da800/0x27a633fcdd4b20a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58c3 expref: 39 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788940489.105244:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:0.0:1788940489.105305:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:0.0:1788940489.105793:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00010000:00010000:0.0:1788940489.105866:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b21f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940489.105887:0:5864:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b1c4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58a0 expref: 43 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940489.105929:0:5864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b21f lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940489.105975:0:5864:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b1c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58a0 expref: 43 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940489.105995:0:5864:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b1c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58a0 expref: 43 pid: 5860 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940489.106013:0:5864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5832a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5864:1875839738257152:192.168.202.14@tcp:104: 00000100:00100000:0.0:1788940489.108338:0:5864:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1b0ca03c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788940489.114620:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940489.115043:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718312576 00000100:00100000:2.0:1788940489.115055:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718312576 00010000:00010000:2.0:1788940489.115110:0:5845:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b1c4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58a0 expref: 44 pid: 5860 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940489.115156:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 51 00000100:00100000:2.0:1788940489.115168:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+44:2352:x1875839718312576:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788940489.115188:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940489.115197:0:5845:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b1c4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58a0 expref: 44 pid: 5860 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940489.115225:0:5845:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b1c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58a0 expref: 44 pid: 5860 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940489.115262:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89f18a6cec00) 00010000:00010000:2.0:1788940489.115270:0:5845:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b21f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940489.115281:0:5845:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b21f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940489.115291:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b21f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940489.115339:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788940489.116028:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b1c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58a0 expref: 44 pid: 5860 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940489.116057:0:5864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5832a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5864:1875839738257152:192.168.202.14@tcp:104: 00010000:00010000:0.0:1788940489.116091:0:5864:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b21f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940489.116102:0:5864:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b21f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940489.116110:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b21f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788940489.116312:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000001:00080000:0.0:1788940489.117201:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:0.0:1788940489.117605:0:5864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5832a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5864:1875839738257280:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788940489.117859:0:5864:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940489.117975:0:5864:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1b0ca0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788940489.118376:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+45:2352:x1875839718312576:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 3205us (3770us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940489.118392:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 51 00000100:00100000:2.0:1788940489.118567:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738257280 00000100:00100000:2.0:1788940489.118579:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738257280 00000100:00100000:2.0:1788940489.118646:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788940489.118656:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b55aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5864:x1875839738257280:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788940489.119134:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b55aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5864:x1875839738257280:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 478us (1274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940489.119143:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788940489.119180:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788940489.119587:0:5864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5832a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5864:1875839738257280:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788940489.121499:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:1.0:1788940489.121651:0:5864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5834380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5864:1875839738257408:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788940489.122076:0:5864:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940489.122172:0:5864:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1a9664180 going to sleep for 11 seconds 00000100:00100000:2.0:1788940489.122655:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738257408 00000100:00100000:2.0:1788940489.122667:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738257408 00000100:00100000:2.0:1788940489.122996:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788940489.123020:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5864:x1875839738257408:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788940489.123557:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5864:x1875839738257408:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 549us (1479us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788940489.123567:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788940489.123683:0:5864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5834380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5864:1875839738257408:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788940489.123821:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:1.0:1788940489.123892:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b21f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.124195:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b21f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.124207:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b21f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.124239:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad2800 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940489.124247:0:5864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b21f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.124259:0:5864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b21f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.124282:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89f18a6cec00) 00010000:00010000:1.0:1788940489.124285:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788940489.124292:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b21f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.124301:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b21f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788940489.124635:0:5864:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788940489.125138:0:5864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:1.0:1788940489.125155:0:5864:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 432023635746ns, next at 433023632921ns, rc = 0 00000001:00080000:1.0:1788940489.125166:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:1.0:1788940489.125285:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89f18a6cec00) 00010000:00010000:1.0:1788940489.125289:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788940489.125300:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829da800/0x27a633fcdd4b20a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58c3 expref: 47 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940489.125547:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b0610050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+46:10532:x1875839718312448:12345-192.168.202.14@tcp:35:lfs.0 Request processed in 21051us (21318us total) trans 4294967389 rc 0/0 00000100:00100000:1.0:1788940489.125558:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 26 00000020:00080000:1.0:1788940489.125564:0:5864:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788940489.128832:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940489.129324:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718312704 00000100:00100000:1.0:1788940489.129359:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718312704 00000100:00100000:1.0:1788940489.129550:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 100 00000100:00100000:1.0:1788940489.129563:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b55a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+46:10532:x1875839718312704:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:1.0:1788940489.129596:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940489.129626:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4b226 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f58ca expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.129886:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4b226 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58ca expref: 47 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.129969:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4b226 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58ca expref: 47 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.129997:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89f188f81400) 00010000:00010000:1.0:1788940489.130001:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788940489.130069:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f19258c200, rc 0) 00000100:00100000:1.0:1788940489.130144:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b55a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+47:10532:x1875839718312704:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 585us (1330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940489.130152:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 100 00000100:00100000:1.0:1788940489.133630:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940489.133670:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718312960 00000100:00100000:0.0:1788940489.133684:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718312960 00000100:00100000:0.0:1788940489.134125:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 27 00000100:00100000:0.0:1788940489.134137:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+47:10532:x1875839718312960:12345-192.168.202.14@tcp:35:lfs.0 00000100:00100000:0.0:1788940489.134490:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+48:10532:x1875839718312960:12345-192.168.202.14@tcp:35:lfs.0 Request processed in 353us (873us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1788940489.134500:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 27 00000100:00100000:1.0:1788940489.230691:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940489.230830:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718313088 00000100:00100000:0.0:1788940489.230844:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718313088 00000100:00100000:1.0:1788940489.231093:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 101 00000100:00100000:1.0:1788940489.231107:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+48:10542:x1875839718313088:12345-192.168.202.14@tcp:34:lfs.0 00010000:00010000:1.0:1788940489.231295:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4b22d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.231321:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4b22d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.231355:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4b22d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.231374:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ce00/0x27a633fcdd4b234 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.231382:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ce00/0x27a633fcdd4b234 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.231389:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ce00/0x27a633fcdd4b234 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.231570:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4b23b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.231580:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4b23b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.231587:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4b23b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788940489.231643:0:5862:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4b23b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.231658:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4b22d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.231666:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4b22d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.231673:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4b22d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.231691:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258d000 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940489.231697:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4b22d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.231706:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4b22d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.231722:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89f188f81300) 00010000:00010000:1.0:1788940489.231726:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940489.231733:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4b22d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.231740:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4b22d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.231755:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ce00/0x27a633fcdd4b234 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.231761:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ce00/0x27a633fcdd4b234 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.231766:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ce00/0x27a633fcdd4b234 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.231771:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258ce00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940489.231773:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ce00/0x27a633fcdd4b234 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.231779:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ce00/0x27a633fcdd4b234 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.231799:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff89f188f81e00) 00010000:00010000:1.0:1788940489.231802:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940489.231805:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ce00/0x27a633fcdd4b234 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.231810:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ce00/0x27a633fcdd4b234 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.231827:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4b23b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.231833:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4b23b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.231838:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4b23b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.231843:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258d800 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940489.231846:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4b23b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.231853:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4b23b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.231860:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89f188f81400) 00010000:00010000:1.0:1788940489.231862:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940489.231865:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4b23b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.231870:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4b23b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940489.232158:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+48:10542:x1875839718313088:12345-192.168.202.14@tcp:34:lfs.0 Request processed in 1051us (1480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940489.232168:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 101 00000100:00100000:1.0:1788940489.269276:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940489.269416:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718313344 00000100:00100000:3.0:1788940489.269428:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718313344 00000100:00100000:3.0:1788940489.269514:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 102 00000100:00100000:3.0:1788940489.269571:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+48:10545:x1875839718313344:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:3.0:1788940489.269602:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940489.269630:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829db200/0x27a633fcdd4b242 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f58d1 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.269736:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829db400/0x27a633fcdd4b249 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.269756:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829db400/0x27a633fcdd4b249 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.269771:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829db400/0x27a633fcdd4b249 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.269791:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829da800/0x27a633fcdd4b250 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.269799:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829da800/0x27a633fcdd4b250 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.269828:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829da800/0x27a633fcdd4b250 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940489.270307:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b257 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940489.270318:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b257 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940489.270326:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b257 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940489.270350:0:5860:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788940489.270499:0:5860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829db400/0x27a633fcdd4b249 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940489.270508:0:5860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829db400/0x27a633fcdd4b249 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940489.270515:0:5860:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829db400/0x27a633fcdd4b249 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940489.270556:0:5860:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1829db400 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940489.270563:0:5860:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829db400/0x27a633fcdd4b249 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940489.270572:0:5860:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829db400/0x27a633fcdd4b249 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940489.270586:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89f188f81300) 00010000:00010000:2.0:1788940489.270590:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940489.270597:0:5860:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829db400/0x27a633fcdd4b249 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940489.270604:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829db400/0x27a633fcdd4b249 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940489.270623:0:5860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829da800/0x27a633fcdd4b250 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940489.270630:0:5860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829da800/0x27a633fcdd4b250 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940489.270635:0:5860:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829da800/0x27a633fcdd4b250 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940489.270647:0:5860:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1829da800 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940489.270651:0:5860:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829da800/0x27a633fcdd4b250 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940489.270657:0:5860:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829da800/0x27a633fcdd4b250 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940489.270666:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff89f18a6ce400) 00010000:00010000:2.0:1788940489.270669:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940489.270672:0:5860:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829da800/0x27a633fcdd4b250 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940489.270678:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829da800/0x27a633fcdd4b250 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940489.270749:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f1829db200/0x27a633fcdd4b242 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58d1 expref: 51 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940489.270770:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b257 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58d1 expref: 50 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940489.270778:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89f188f81400) 00010000:00010000:2.0:1788940489.270780:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788940489.270783:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f188daac00, rc 0) 00000100:00100000:2.0:1788940489.270891:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+50:10545:x1875839718313344:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 1324us (1632us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1788940489.270900:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 102 00000100:00100000:2.0:1788940489.273949:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940489.274095:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718313472 00000100:00100000:3.0:1788940489.274108:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718313472 00000100:00100000:3.0:1788940489.274177:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 103 00000100:00100000:3.0:1788940489.274188:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bff61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+50:10545:x1875839718313472:12345-192.168.202.14@tcp:54:lfs.0 00010000:00010000:3.0:1788940489.274295:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b265 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.274317:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b265 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.274334:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b265 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.274369:0:7857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b265 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.274377:0:7857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b265 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.274386:0:7857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b265 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.274394:0:7857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f180030a00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940489.274399:0:7857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b265 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.274409:0:7857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b265 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.274434:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89f188f81400) 00010000:00010000:3.0:1788940489.274437:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788940489.274444:0:7857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b265 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.274461:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b265 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940489.274627:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bff61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+50:10545:x1875839718313472:12345-192.168.202.14@tcp:54:lfs.0 Request processed in 439us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940489.274635:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 103 00000100:00100000:1.0:1788940489.278133:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940489.278253:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718313728 00000100:00100000:0.0:1788940489.278267:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718313728 00000100:00100000:0.0:1788940489.278339:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 28 00000100:00100000:0.0:1788940489.278351:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+50:10545:x1875839718313728:12345-192.168.202.14@tcp:35:lfs.0 00000100:00100000:0.0:1788940489.278719:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+51:10545:x1875839718313728:12345-192.168.202.14@tcp:35:lfs.0 Request processed in 369us (609us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1788940489.278728:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 28 00000100:00100000:2.0:1788940489.374845:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940489.375030:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718313984 00000100:00100000:1.0:1788940489.375042:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718313984 00000100:00100000:1.0:1788940489.375105:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 104 00000100:00100000:1.0:1788940489.375124:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bff61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+51:10555:x1875839718313984:12345-192.168.202.14@tcp:101:bash.0 00010000:00010000:1.0:1788940489.375156:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940489.375160:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788940489.375193:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4b1e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58b5 expref: 51 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.375224:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89f188f81300) 00010000:00010000:1.0:1788940489.375230:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788940489.375245:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ce00/0x27a633fcdd4b26c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f58d8 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.375368:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4b273 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.375396:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b257 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58d1 expref: 51 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.375406:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4b273 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.375477:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b257 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58d1 expref: 51 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.375491:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b257 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58d1 expref: 51 pid: 5860 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940489.375508:0:5861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5830700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5861:1875839738257536:192.168.202.14@tcp:104: 00000100:00100000:1.0:1788940489.375867:0:5861:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f186823300 going to sleep for 11 seconds 00000100:00100000:1.0:1788940489.380872:0:5861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5830700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5861:1875839738257536:192.168.202.14@tcp:104: 00010000:00010000:1.0:1788940489.380932:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4b273 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940489.382825:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940489.383335:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718314112 00000100:00100000:0.0:1788940489.383352:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718314112 00010000:00010000:0.0:1788940489.383432:0:8470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b257 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58d1 expref: 52 pid: 5860 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940489.383498:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 52 00000100:00100000:0.0:1788940489.383511:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bff60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+52:2353:x1875839718314112:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940489.383839:0:8470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940489.383848:0:8470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b257 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58d1 expref: 52 pid: 5860 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940489.383867:0:8470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b257 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58d1 expref: 52 pid: 5860 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940489.383895:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b257 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58d1 expref: 52 pid: 5860 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940489.383987:0:8470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89f188f81400) 00010000:00010000:0.0:1788940489.383994:0:8470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4b273 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940489.384006:0:8470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4b273 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940489.384015:0:8470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4b273 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940489.384052:0:8470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788940489.384188:0:5861:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4b273 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.384198:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4b273 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940489.384232:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788940489.384442:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ce00/0x27a633fcdd4b26c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58d8 expref: 53 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.384468:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4b273 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58d8 expref: 52 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.384476:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89f188f81400) 00010000:00010000:1.0:1788940489.384486:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788940489.384497:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f19258d000, rc 0) 00000100:00100000:1.0:1788940489.384605:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bff61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+52:10555:x1875839718313984:12345-192.168.202.14@tcp:101:bash.0 Request processed in 9482us (9772us total) trans 4294967393 rc 0/0 00000100:00100000:1.0:1788940489.384614:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 104 00000100:00100000:0.0:1788940489.385402:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bff60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+51:2353:x1875839718314112:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 1889us (2584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940489.385413:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 52 00010000:00010000:0.0:1788940489.388748:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940489.390179:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940489.390391:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718314368 00000100:00100000:3.0:1788940489.390405:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718314368 00000100:00100000:3.0:1788940489.390498:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 105 00000100:00100000:3.0:1788940489.390509:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bff63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+51:10555:x1875839718314368:12345-192.168.202.14@tcp:36:bash.0 00010000:00010000:3.0:1788940489.391310:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b281 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.391345:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b281 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.391361:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b281 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788940489.391773:0:7857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967394 00000004:00010000:3.0:1788940489.391812:0:7857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004f722038 reply state 00000000450300a9 transno 4294967395 ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b281 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940489.391826:0:7857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788940489.392185:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bff63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+54:10555:x1875839718314368:12345-192.168.202.14@tcp:36:bash.0 Request processed in 1671us (2014us total) trans 4294967395 rc 0/0 00000100:00100000:3.0:1788940489.392195:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 105 00000020:00080000:3.0:1788940489.392201:0:7857:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788940489.399037:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940489.399086:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718314496 00000100:00100000:2.0:1788940489.399098:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718314496 00000100:00100000:2.0:1788940489.399163:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 106 00000100:00100000:2.0:1788940489.399176:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bff61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+54:10555:x1875839718314496:12345-192.168.202.14@tcp:101:bash.0 00010000:00010000:1.0:1788940489.399315:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b281 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.399328:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b281 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.399336:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b281 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.399342:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f180030a00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940489.399348:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b281 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.399357:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b281 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.399376:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89f188f81400) 00010000:00010000:1.0:1788940489.399388:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940489.399395:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b281 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.399402:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b281 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940489.400264:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940489.400297:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4b288 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f58df expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940489.400420:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa800/0x27a633fcdd4b28f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940489.400438:0:5860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4b273 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58d8 expref: 54 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940489.400458:0:5860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa800/0x27a633fcdd4b28f lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940489.400501:0:5860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4b273 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58d8 expref: 54 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940489.400542:0:5860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4b273 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58d8 expref: 54 pid: 5861 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940489.400558:0:5860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bff61880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5860:1875839738257664:192.168.202.14@tcp:104: 00000100:00100000:2.0:1788940489.400683:0:5860:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f19860d900 going to sleep for 11 seconds 00000100:00100000:2.0:1788940489.403955:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940489.404126:0:5860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bff61880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5860:1875839738257664:192.168.202.14@tcp:104: 00010000:00010000:3.0:1788940489.404165:0:5860:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa800/0x27a633fcdd4b28f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940489.405150:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718314624 00000100:00100000:1.0:1788940489.405167:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718314624 00010000:00010000:1.0:1788940489.405239:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4b273 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58d8 expref: 55 pid: 5861 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940489.405310:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 53 00000100:00100000:1.0:1788940489.405321:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bff60000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+55:2352:x1875839718314624:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788940489.405345:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940489.405353:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4b273 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58d8 expref: 55 pid: 5861 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.405369:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4b273 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58d8 expref: 55 pid: 5861 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.405409:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4b273 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58d8 expref: 55 pid: 5861 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.405427:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89f188f81400) 00010000:00010000:1.0:1788940489.405434:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa800/0x27a633fcdd4b28f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.405445:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa800/0x27a633fcdd4b28f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.405464:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa800/0x27a633fcdd4b28f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.405506:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940489.405591:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bff60000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+54:2352:x1875839718314624:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 271us (1650us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940489.405599:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 53 00010000:00010000:3.0:1788940489.405724:0:5860:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa800/0x27a633fcdd4b28f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.405733:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa800/0x27a633fcdd4b28f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940489.405796:0:5860:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788940489.405802:0:5860:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788940489.405828:0:5860:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa800/0x27a633fcdd4b28f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.405865:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4b288 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58df expref: 54 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.405882:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa800/0x27a633fcdd4b28f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58df expref: 53 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.405890:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89f188f81400) 00010000:00010000:3.0:1788940489.405892:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788940489.405895:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f188daa800, rc 0) 00000100:00100000:3.0:1788940489.405937:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bff61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+53:10555:x1875839718314496:12345-192.168.202.14@tcp:101:bash.0 Request processed in 6765us (6917us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940489.405956:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 106 00000100:00100000:1.0:1788940489.409242:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940489.409414:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718314880 00000100:00100000:2.0:1788940489.409427:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718314880 00000100:00100000:2.0:1788940489.409559:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 29 00000100:00100000:2.0:1788940489.409573:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5830700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+53:10555:x1875839718314880:12345-192.168.202.14@tcp:35:bash.0 00000100:00100000:2.0:1788940489.409931:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5830700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+54:10555:x1875839718314880:12345-192.168.202.14@tcp:35:bash.0 Request processed in 361us (718us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1788940489.409940:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 29 00000100:00100000:2.0:1788940489.489438:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940489.489604:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718315008 00000100:00100000:1.0:1788940489.489618:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718315008 00000100:00100000:1.0:1788940489.489694:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 107 00000100:00100000:1.0:1788940489.489707:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bff61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+54:10561:x1875839718315008:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:1.0:1788940489.489741:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940489.489768:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4b296 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f58e6 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.489874:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4b29d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.489894:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4b29d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.489921:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4b29d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940489.489969:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788940489.489974:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788940489.489997:0:5862:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4b29d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.490029:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4b296 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58e6 expref: 56 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.490052:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4b29d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58e6 expref: 55 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.490061:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89f188f81300) 00010000:00010000:1.0:1788940489.490064:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788940489.490085:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f19258dc00, rc 0) 00000100:00100000:1.0:1788940489.490164:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bff61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+55:10561:x1875839718315008:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 459us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940489.490172:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 107 00000100:00100000:3.0:1788940489.495899:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940489.496027:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718315136 00000100:00100000:1.0:1788940489.496040:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718315136 00000100:00100000:1.0:1788940489.496109:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 108 00000100:00100000:1.0:1788940489.496120:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+55:10561:x1875839718315136:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:1.0:1788940489.496147:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940489.496172:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4b2a4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f58ed expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.496255:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4b2ab lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.496274:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4b2ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.496291:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4b2ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.496309:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4b2b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.496316:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4b2b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.496322:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4b2b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.496463:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4b2b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.496498:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4b2b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.496506:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4b2b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940489.496586:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788940489.496591:0:5861:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788940489.496616:0:5861:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4b2b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.496629:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4b2b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.496639:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4b2ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.496646:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4b2ab lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.496653:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4b2ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.496660:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258c600 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940489.496665:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4b2ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.496675:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4b2ab lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.496690:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89f188f81300) 00010000:00010000:1.0:1788940489.496693:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940489.496707:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4b2ab lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.496715:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4b2ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.496733:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4b2b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.496740:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4b2b2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.496745:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4b2b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.496751:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258c000 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940489.496753:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4b2b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.496759:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4b2b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.496766:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff89f188f81e00) 00010000:00010000:1.0:1788940489.496769:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940489.496771:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4b2b2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.496777:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4b2b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.496817:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4b2a4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58ed expref: 57 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.496846:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4b2b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58ed expref: 56 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.496856:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89f188f81400) 00010000:00010000:1.0:1788940489.496858:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788940489.496861:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f19258d400, rc 0) 00000100:00100000:1.0:1788940489.496953:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+56:10561:x1875839718315136:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 835us (1069us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940489.496961:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 108 00000100:00100000:2.0:1788940489.501499:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940489.503073:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940489.503179:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718315520 00000100:00100000:0.0:1788940489.503192:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718315520 00000100:00100000:0.0:1788940489.503287:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 7 00000100:00100000:0.0:1788940489.503300:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbdb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+56:2353:x1875839718315520:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940489.503339:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940489.503373:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4b2b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58ed expref: 56 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940489.503409:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89f188f81400) 00010000:00010000:0.0:1788940489.503415:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940489.503507:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbdb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+55:2353:x1875839718315520:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 209us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940489.503516:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 7 00000100:00100000:1.0:1788940489.505779:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718315392 00000100:00100000:1.0:1788940489.505798:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718315392 00000100:00100000:1.0:1788940489.505929:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 109 00000100:00100000:1.0:1788940489.505941:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bff60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+55:10561:x1875839718315392:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:1.0:1788940489.505968:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940489.505995:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b2c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f58f4 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.506141:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258cc00/0x27a633fcdd4b2c7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.506162:0:5862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa800/0x27a633fcdd4b28f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58df expref: 56 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.506172:0:5862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258cc00/0x27a633fcdd4b2c7 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.506232:0:5862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa800/0x27a633fcdd4b28f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58df expref: 56 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.506267:0:5862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa800/0x27a633fcdd4b28f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58df expref: 56 pid: 5860 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940489.506283:0:5862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5833480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5862:1875839738257792:192.168.202.14@tcp:104: 00000100:00100000:1.0:1788940489.506487:0:5862:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f186823300 going to sleep for 11 seconds 00000100:00100000:1.0:1788940489.511075:0:5862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5833480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5862:1875839738257792:192.168.202.14@tcp:104: 00010000:00010000:1.0:1788940489.511124:0:5862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258cc00/0x27a633fcdd4b2c7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940489.511283:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940489.511691:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718315648 00000100:00100000:1.0:1788940489.511700:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718315648 00010000:00010000:1.0:1788940489.511750:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa800/0x27a633fcdd4b28f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58df expref: 57 pid: 5860 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940489.511794:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 54 00000100:00100000:1.0:1788940489.511805:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1841b4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+57:2352:x1875839718315648:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788940489.511826:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940489.511833:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa800/0x27a633fcdd4b28f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58df expref: 57 pid: 5860 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.511847:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa800/0x27a633fcdd4b28f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58df expref: 57 pid: 5860 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.511874:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa800/0x27a633fcdd4b28f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58df expref: 57 pid: 5860 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.511925:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89f188f81400) 00010000:00010000:1.0:1788940489.511931:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258cc00/0x27a633fcdd4b2c7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.511941:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258cc00/0x27a633fcdd4b2c7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.511951:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258cc00/0x27a633fcdd4b2c7 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.511983:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940489.512059:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1841b4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+56:2352:x1875839718315648:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 248us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940489.512068:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 54 00010000:00010000:3.0:1788940489.512648:0:5862:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258cc00/0x27a633fcdd4b2c7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.512659:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258cc00/0x27a633fcdd4b2c7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940489.512686:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788940489.513021:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b2c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58f4 expref: 57 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.513042:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258cc00/0x27a633fcdd4b2c7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58f4 expref: 56 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.513050:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89f188f81400) 00010000:00010000:3.0:1788940489.513113:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788940489.513117:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f19258cc00, rc 0) 00000100:00100000:3.0:1788940489.513166:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bff60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+56:10561:x1875839718315392:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 7227us (11680us total) trans 4294967397 rc 0/0 00000100:00100000:3.0:1788940489.513176:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 109 00000100:00100000:2.0:1788940489.525750:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940489.526017:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718315904 00000100:00100000:1.0:1788940489.526030:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718315904 00000100:00100000:1.0:1788940489.526128:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 8 00000100:00100000:1.0:1788940489.526142:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bff63100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+56:10561:x1875839718315904:12345-192.168.202.14@tcp:103:lfs.0 00010000:00010000:1.0:1788940489.526165:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940489.526858:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4b226 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58ca expref: 56 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.526888:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89f188f81400) 00010000:00010000:1.0:1788940489.526896:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940489.527046:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bff63100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+55:10561:x1875839718315904:12345-192.168.202.14@tcp:103:lfs.0 Request processed in 905us (1312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940489.527056:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 8 00000100:00100000:0.0:1788940489.531024:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940489.531281:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718316032 00000100:00100000:1.0:1788940489.531297:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718316032 00000100:00100000:1.0:1788940489.531570:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 110 00000100:00100000:1.0:1788940489.531584:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b55a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+55:10561:x1875839718316032:12345-192.168.202.14@tcp:58:lfs.0 00010000:00010000:1.0:1788940489.531771:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4b2d5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.531799:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4b2d5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.531817:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4b2d5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788940489.532473:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1788940489.532915:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b55a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+55:10561:x1875839718316032:12345-192.168.202.14@tcp:58:lfs.0 Request processed in 1323us (1894us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940489.532927:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 110 00000100:00100000:2.0:1788940489.536760:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940489.536860:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718316160 00000100:00100000:1.0:1788940489.536874:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718316160 00000100:00100000:1.0:1788940489.536970:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 111 00000100:00100000:1.0:1788940489.536984:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bff63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+55:10561:x1875839718316160:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:1.0:1788940489.537015:0:7857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940489.537062:0:7857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4b2dc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f58fb expref: -99 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.537153:0:7857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4b2d5 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.537169:0:7857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4b2dc lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58fb expref: 56 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.537218:0:7857:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4b2d5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.537238:0:7857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4b2dc lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58fb expref: 56 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.537257:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89f188f81400) 00010000:00010000:1.0:1788940489.537261:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788940489.537265:0:7857:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4b2dc lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58fb expref: 56 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.537274:0:7857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f19258c000, rc 0) 00000100:00100000:1.0:1788940489.537349:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bff63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+56:10561:x1875839718316160:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 369us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940489.537357:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 111 00000040:00080000:1.0:1788940489.711673:0:11708:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788940489.711689:0:11708:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788940489.711750:0:11708:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1788940489.711759:0:11708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788940489.712004:0:11708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5833480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11708:1875839738257920:192.168.202.14@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788940489.712146:0:11708:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f186823840 going to sleep for 11 seconds 00000100:00100000:2.0:1788940489.721666:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940489.722223:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718316288 00000100:00100000:3.0:1788940489.722237:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718316288 00000100:00100000:3.0:1788940489.722325:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 112 00000100:00100000:3.0:1788940489.722348:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bff63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+57:10562:x1875839718316288:12345-192.168.202.14@tcp:53:lhsmtool_posix.0 00000100:00100000:1.0:1788940489.722982:0:11708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5833480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11708:1875839738257920:192.168.202.14@tcp:107:hsm_cdtr.0 00000004:00000080:3.0:1788940489.724825:0:5860:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788940489.725752:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bff63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+56:10562:x1875839718316288:12345-192.168.202.14@tcp:53:lhsmtool_posix.0 Request processed in 3058us (3743us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940489.725770:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 112 00000100:00100000:2.0:1788940489.740879:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940489.741081:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718316416 00000100:00100000:1.0:1788940489.741094:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718316416 00000100:00100000:1.0:1788940489.741169:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 113 00000100:00100000:1.0:1788940489.741181:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bff60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+56:10562:x1875839718316416:12345-192.168.202.14@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788940489.741323:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4b2e3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.741346:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4b2e3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.741363:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4b2e3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.747035:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4b2ea lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.747060:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4b2ea lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.747074:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4b2ea lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.747111:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b2f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.747120:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b2f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.747127:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b2f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940489.747186:0:7857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788940489.747192:0:7857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788940489.747212:0:7857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b2f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.747225:0:7857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4b2e3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.747250:0:7857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4b2e3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.747257:0:7857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4b2e3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.747263:0:7857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258c200 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940489.747268:0:7857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4b2e3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.747275:0:7857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4b2e3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.747288:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89f186946200) 00010000:00010000:1.0:1788940489.747291:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940489.747296:0:7857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4b2e3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.747302:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4b2e3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.747319:0:7857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4b2ea lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.747325:0:7857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4b2ea lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.747343:0:7857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4b2ea lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.747349:0:7857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258c600 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940489.747358:0:7857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4b2ea lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.747365:0:7857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4b2ea lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.747373:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff89f188f81e00) 00010000:00010000:1.0:1788940489.747376:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940489.747379:0:7857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4b2ea lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.747385:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4b2ea lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.749196:0:7857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b2f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.749212:0:7857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b2f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.749219:0:7857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b2f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.749225:0:7857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258c400 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940489.749230:0:7857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b2f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.749237:0:7857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b2f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.749253:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89f188f81400) 00010000:00010000:1.0:1788940489.749256:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940489.749282:0:7857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b2f1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.749288:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b2f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940489.749721:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bff60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+56:10562:x1875839718316416:12345-192.168.202.14@tcp:34:lhsmtool_posix.0 Request processed in 8535us (8852us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940489.749732:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 113 00000100:00100000:1.0:1788940489.782016:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940489.782392:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718316672 00000100:00100000:2.0:1788940489.782404:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718316672 00000100:00100000:2.0:1788940489.782510:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 114 00000100:00100000:2.0:1788940489.782557:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+56:10562:x1875839718316672:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788940489.782582:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940489.782604:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4b2f8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5902 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940489.782711:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4b2ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940489.782728:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4b2ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940489.782758:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4b2ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940489.782772:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788940489.782877:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4b2ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940489.782886:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4b2ff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940489.782893:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4b2ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940489.782914:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188dabe00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940489.782918:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4b2ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940489.782926:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4b2ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940489.782939:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89f188f81400) 00010000:00010000:2.0:1788940489.782942:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788940489.782948:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4b2ff lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940489.782954:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4b2ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940489.782998:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4b2f8 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5902 expref: 58 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940489.783019:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89f186946200) 00010000:00010000:2.0:1788940489.783022:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788940489.783027:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4b2f8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5902 expref: 58 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940489.783037:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f188dab600, rc 0) 00000100:00100000:2.0:1788940489.783115:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+57:10562:x1875839718316672:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 561us (1113us total) trans 4294967398 rc 301/301 00000100:00100000:2.0:1788940489.783122:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 114 00000100:00100000:2.0:1788940489.790489:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940489.790732:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718316800 00000100:00100000:3.0:1788940489.790744:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718316800 00000100:00100000:3.0:1788940489.790817:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 115 00000100:00100000:3.0:1788940489.790830:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bff60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+57:10562:x1875839718316800:12345-192.168.202.14@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788940489.790873:0:5862:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788940489.791003:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bff60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+57:10562:x1875839718316800:12345-192.168.202.14@tcp:53:lhsmtool_posix.0 Request processed in 175us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940489.791011:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 115 00000100:00100000:1.0:1788940489.799010:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940489.799145:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718317056 00000100:00100000:2.0:1788940489.799157:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718317056 00000100:00100000:2.0:1788940489.799433:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 116 00000100:00100000:2.0:1788940489.799456:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+57:10562:x1875839718317056:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788940489.799483:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940489.799487:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788940489.799549:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4b29d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58e6 expref: 57 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940489.799571:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89f188f81300) 00010000:00010000:2.0:1788940489.799577:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788940489.799594:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4b30d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5909 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788940489.800096:0:5861:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1788940489.800373:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4b314 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940489.800388:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4b314 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940489.800400:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4b314 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940489.800470:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4b30d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5909 expref: 59 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940489.800489:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4b314 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5909 expref: 58 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940489.800497:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff89f186946d00) 00010000:00010000:2.0:1788940489.800500:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788940489.800503:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f188dabe00, rc 0) 00000100:00100000:2.0:1788940489.801774:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+58:10562:x1875839718317056:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 2318us (2764us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1788940489.801789:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 116 00000100:00100000:0.0:1788940489.809803:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940489.809994:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718317312 00000100:00100000:3.0:1788940489.810007:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718317312 00000100:00100000:3.0:1788940489.810123:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 117 00000100:00100000:3.0:1788940489.810135:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b55aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+58:10562:x1875839718317312:12345-192.168.202.14@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788940489.810195:0:5862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940489.810234:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4b314 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5909 expref: 58 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.810253:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff89f186946d00) 00010000:00010000:3.0:1788940489.810265:0:5862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788940489.810287:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b322 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.810300:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b322 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.810310:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b322 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.810410:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b329 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x6014baa1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.810419:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b329 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x6014baa1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.810427:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b329 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x6014baa1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.810685:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b322 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.810694:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b322 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.810700:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b322 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.810706:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f180031800 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940489.810710:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b322 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.810717:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b322 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.810725:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89f188f81300) 00010000:00010000:3.0:1788940489.810728:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940489.810732:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b322 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.810738:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b322 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.810757:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b329 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x6014baa1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.810763:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b329 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x6014baa1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.810769:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b329 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x6014baa1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.810774:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f180030000 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940489.810777:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b329 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x6014baa1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.810784:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b329 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x6014baa1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.810792:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x6014baa1 (ffff89f18a6ce000) 00010000:00010000:3.0:1788940489.810795:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940489.810799:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b329 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x6014baa1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.810807:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b329 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x6014baa1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940489.810914:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b55aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+57:10562:x1875839718317312:12345-192.168.202.14@tcp:36:lhsmtool_posix.0 Request processed in 780us (1120us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788940489.810923:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 117 00000100:00100000:1.0:1788940489.817712:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940489.817791:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718317440 00000100:00100000:3.0:1788940489.817804:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718317440 00000100:00100000:3.0:1788940489.817874:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 118 00000100:00100000:3.0:1788940489.817915:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ba974700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+57:10562:x1875839718317440:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788940489.817941:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940489.817976:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b330 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5910 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.818018:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b337 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.818033:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b337 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.818045:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b337 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.818148:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b330 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5910 expref: 59 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.818169:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b337 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5910 expref: 58 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.818177:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff89f18a6ce500) 00010000:00010000:3.0:1788940489.818180:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788940489.818185:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f180030c00, rc 0) 00000100:00100000:3.0:1788940489.818277:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ba974700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+58:10562:x1875839718317440:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 376us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940489.818284:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 118 00000100:00100000:2.0:1788940489.822585:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940489.822687:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718317696 00000100:00100000:1.0:1788940489.822701:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718317696 00000100:00100000:1.0:1788940489.822771:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 119 00000100:00100000:1.0:1788940489.822783:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bff61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+58:10562:x1875839718317696:12345-192.168.202.14@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788940489.822870:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4b33e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.822887:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4b33e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.822899:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4b33e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788940489.823197:0:7857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:1.0:1788940489.823208:0:7857:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 432721688574ns, next at 433721686286ns, rc = 0 00000004:00010000:1.0:1788940489.823308:0:7857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008fe4150f reply state 0000000039e138d5 transno 4294967400 ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4b33e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940489.823319:0:7857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788940489.823464:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bff61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+60:10562:x1875839718317696:12345-192.168.202.14@tcp:36:lhsmtool_posix.0 Request processed in 665us (869us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1788940489.823472:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 119 00000100:00100000:1.0:1788940489.834322:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00010000:00010000:3.0:1788940489.834426:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4b33e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.834472:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4b33e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.834479:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4b33e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.834486:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258d400 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940489.834502:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4b33e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.834512:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4b33e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.834571:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff89f18a6ce500) 00010000:00010000:3.0:1788940489.834575:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788940489.834580:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4b33e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.834587:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4b33e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940489.834893:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718317824 00000100:00100000:2.0:1788940489.834915:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718317824 00000100:00100000:2.0:1788940489.834979:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 120 00000100:00100000:2.0:1788940489.834990:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ba976a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+59:10562:x1875839718317824:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788940489.835016:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940489.835036:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b345 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5917 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940489.835121:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b345 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5917 expref: 60 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940489.835136:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b345 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5917 expref: 60 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940489.835159:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff89f18a6ce500) 00010000:00010000:2.0:1788940489.835162:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788940489.835165:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f188daa600, rc 0) 00000100:00100000:2.0:1788940489.836349:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ba976a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+60:10562:x1875839718317824:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 1349us (2030us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940489.836363:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 120 00000100:00100000:2.0:1788940489.853185:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940489.853374:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718317952 00000100:00100000:1.0:1788940489.853387:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718317952 00000100:00100000:1.0:1788940489.853467:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 37 00000100:00100000:1.0:1788940489.853479:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bff60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+8:2352:x1875839718317952:12345-192.168.202.14@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788940489.853890:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bff60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+9:2352:x1875839718317952:12345-192.168.202.14@tcp:2:lhsmtool_posix.0 Request processed in 410us (714us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788940489.854068:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 37 00000100:00100000:3.0:1788940489.860372:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940489.860637:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718318208 00000100:00100000:2.0:1788940489.860650:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718318208 00000100:00100000:2.0:1788940489.860728:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 30 00000100:00100000:2.0:1788940489.860741:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+60:10562:x1875839718318208:12345-192.168.202.14@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788940489.861197:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+61:10562:x1875839718318208:12345-192.168.202.14@tcp:35:lhsmtool_posix.0 Request processed in 456us (835us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1788940489.861206:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 30 00000100:00100000:0.0:1788940489.875763:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940489.875872:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718318464 00000100:00100000:1.0:1788940489.875885:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718318464 00000100:00100000:1.0:1788940489.876030:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 121 00000100:00100000:1.0:1788940489.876043:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f184197480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+61:10562:x1875839718318464:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788940489.876175:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f184197480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+61:10562:x1875839718318464:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 Request processed in 134us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940489.876182:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 121 00000100:00100000:2.0:1788940489.887645:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940489.887890:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718318592 00000100:00100000:3.0:1788940489.888101:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718318592 00000100:00100000:3.0:1788940489.888176:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 122 00000100:00100000:3.0:1788940489.888188:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bff62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+61:10562:x1875839718318592:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788940489.888385:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940489.888407:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b34c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f591e expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.888509:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b353 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.888660:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b353 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.888674:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b353 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940489.888708:0:5860:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788940489.888725:0:5860:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b353 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.888752:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b34c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f591e expref: 63 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.888771:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b353 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f591e expref: 62 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940489.888780:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff89f18a6ce500) 00010000:00010000:3.0:1788940489.888783:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788940489.888787:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f180030000, rc 0) 00000100:00100000:3.0:1788940489.888904:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bff62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+62:10562:x1875839718318592:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 710us (1259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940489.888912:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 122 00000100:00100000:2.0:1788940489.902391:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940489.903098:0:7074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718318720 00000100:00100000:0.0:1788940489.903112:0:7074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718318720 00000100:00100000:0.0:1788940489.903200:0:7074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 38 00000100:00100000:0.0:1788940489.903221:0:7074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1841d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+9:2353:x1875839718318720:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788940489.903242:0:7074:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940489.903266:0:7074:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000912f2fa4/0x27a633fcdd4b35a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5925 expref: -99 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788940489.903297:0:7074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa110ca, blocks: 0x1 00010000:00010000:0.0:1788940489.903318:0:7074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=432s v=(0 0) 00010000:00010000:0.0:1788940489.903323:0:7074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940489.903334:0:7074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000912f2fa4/0x27a633fcdd4b35a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5925 expref: 10 pid: 7074 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940489.903378:0:7074:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000912f2fa4/0x27a633fcdd4b35a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5925 expref: 10 pid: 7074 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940489.903393:0:7074:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f082ad2000, rc 0) 00000100:00100000:0.0:1788940489.903481:0:7074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1841d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+10:2353:x1875839718318720:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 261us (1097us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940489.903488:0:7074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 38 00000100:00100000:0.0:1788940489.908149:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940489.908261:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718318976 00000100:00100000:1.0:1788940489.908275:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718318976 00000100:00100000:1.0:1788940489.908347:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 123 00000100:00100000:1.0:1788940489.908360:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f184195c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+62:10562:x1875839718318976:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788940489.908514:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f184195c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+62:10562:x1875839718318976:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 Request processed in 157us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940489.908568:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 123 00000100:00100000:3.0:1788940489.915395:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940489.915709:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718319104 00000100:00100000:1.0:1788940489.915738:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718319104 00000100:00100000:1.0:1788940489.915808:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 39 00000100:00100000:1.0:1788940489.915821:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+10:10562:x1875839718319104:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788940489.915842:0:6708:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940489.915863:0:6708:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002948a24c/0x27a633fcdd4b361 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f592c expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.915910:0:6708:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000912f2fa4/0x27a633fcdd4b35a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5925 expref: 11 pid: 7074 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.915920:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940489.915924:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940489.915930:0:6708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002948a24c/0x27a633fcdd4b361 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f592c expref: 11 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.915966:0:6708:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000912f2fa4/0x27a633fcdd4b35a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5925 expref: 11 pid: 7074 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.915980:0:6708:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000912f2fa4/0x27a633fcdd4b35a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5925 expref: 11 pid: 7074 timeout: 532 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940489.915995:0:6708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf555880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6708:1875839738258048:192.168.202.14@tcp:104: 00000100:00100000:1.0:1788940489.916094:0:6708:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f186823240 going to sleep for 11 seconds 00000100:00100000:1.0:1788940489.919487:0:6708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf555880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6708:1875839738258048:192.168.202.14@tcp:104: 00010000:00010000:1.0:1788940489.919579:0:6708:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002948a24c/0x27a633fcdd4b361 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f592c expref: 11 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.919624:0:6708:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f19258ce00, rc 0) 00000100:00100000:1.0:1788940489.919694:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+11:10562:x1875839718319104:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 3874us (4308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940489.919703:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 39 00000100:00100000:0.0:1788940489.922785:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940489.923119:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718319232 00000100:00100000:1.0:1788940489.923132:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718319232 00010000:00010000:1.0:1788940489.923180:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000912f2fa4/0x27a633fcdd4b35a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5925 expref: 11 pid: 7074 timeout: 532 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940489.923351:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 55 00000100:00100000:1.0:1788940489.923363:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f184195500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+11:2353:x1875839718319232:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788940489.923381:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940489.923405:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000912f2fa4/0x27a633fcdd4b35a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5925 expref: 11 pid: 7074 timeout: 532 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.923420:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000912f2fa4/0x27a633fcdd4b35a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5925 expref: 11 pid: 7074 timeout: 532 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.923456:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000912f2fa4/0x27a633fcdd4b35a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5925 expref: 11 pid: 7074 timeout: 532 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.923476:0:5846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940489.923480:0:5846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940489.923489:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002948a24c/0x27a633fcdd4b361 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f592c expref: 10 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.923587:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002948a24c/0x27a633fcdd4b361 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f592c expref: 10 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940489.923631:0:5846:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002948a24c/0x27a633fcdd4b361 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f592c expref: 10 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940489.923646:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf555880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5846:1875839738258176:192.168.202.14@tcp:105: 00000100:00100000:1.0:1788940489.923746:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f186823240 going to sleep for 11 seconds 00000100:00100000:1.0:1788940489.926916:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf555880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5846:1875839738258176:192.168.202.14@tcp:105: 00010000:00010000:1.0:1788940489.926948:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940489.927001:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f184195500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+10:2353:x1875839718319232:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 3640us (4224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940489.927012:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 55 00000100:00100000:3.0:1788940489.932096:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940489.932332:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718319360 00000100:00100000:2.0:1788940489.932346:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718319360 00002000:00100000:2.0:1788940489.932414:0:6713:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff89f1bfbdad80 x1875839718319360/t0(0) o4->9c51ff78-d02d-4e61-8a10-a2f8830f1679@192.168.202.14@tcp:465/0 lens 504/0 e 0 to 0 dl 1788940500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788940489.932453:0:6713:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89f1bfbdad80 with x1875839718319360 ext(0->12) 00002000:00010000:2.0:1788940489.932461:0:6713:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89f1bfbdad80 00000100:00100000:2.0:1788940489.932510:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 2 00000100:00100000:2.0:1788940489.932557:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+10:2353:x1875839718319360:12345-192.168.202.14@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788940489.933054:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+12:2353:x1875839718319360:12345-192.168.202.14@tcp:4:lhsmtool_posix.0 Request processed in 532us (967us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788940489.933063:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 2 00002000:00100000:2.0:1788940489.933070:0:6713:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff89f1bfbdad80 x1875839718319360/t4294967308(0) o4->9c51ff78-d02d-4e61-8a10-a2f8830f1679@192.168.202.14@tcp:465/0 lens 504/448 e 0 to 0 dl 1788940500 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788940489.933079:0:6713:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89f1bfbdad80 with x1875839718319360 ext(0->12) 00002000:00010000:2.0:1788940489.933084:0:6713:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89f1bfbdad80 00000100:00100000:0.0:1788940489.936346:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940489.936439:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718319488 00000100:00100000:1.0:1788940489.936460:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718319488 00000100:00100000:1.0:1788940489.936570:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 124 00000100:00100000:1.0:1788940489.936582:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f184197b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+62:10562:x1875839718319488:12345-192.168.202.14@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788940490.022865:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967392 is committed 00000004:00080000:2.0:1788940490.023120:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000001:00080000:2.0:1788940490.023177:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:2.0:1788940490.023181:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:2.0:1788940490.023192:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:2.0:1788940490.023209:0:5883:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89f191e3b540 refcount 2 committed 0 result 0 batchid 3 00000100:00100000:1.0:1788940490.023490:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf555880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738258304:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788940490.023604:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940490.023681:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788940490.023687:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf555c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738258432:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788940490.023709:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940490.023744:0:7074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738258304 00000100:00100000:1.0:1788940490.023767:0:7074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738258304 00000100:00100000:1.0:1788940490.023826:0:7074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738258432 00000100:00100000:1.0:1788940490.023829:0:7074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738258432 00000100:00100000:1.0:1788940490.023850:0:7074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788940490.023859:0:7074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf556d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3307:x1875839738258304:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788940490.024018:0:7074:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:1.0:1788940490.024046:0:7074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf131944/0x27a633fcdd4b368 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.024068:0:7074:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002cfe34ce/0x27a633fcdd4b12a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f588b expref: 11 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.024078:0:7074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788940490.024083:0:7074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788940490.024088:0:7074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf131944/0x27a633fcdd4b368 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.024115:0:7074:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002cfe34ce/0x27a633fcdd4b12a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f588b expref: 11 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.024129:0:7074:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002cfe34ce/0x27a633fcdd4b12a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f588b expref: 11 pid: 6705 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940490.024141:0:7074:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf557100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7074:1875839738258560:192.168.202.14@tcp:104: 00000100:00100000:1.0:1788940490.024201:0:7074:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f186823240 going to sleep for 11 seconds 00000020:00080000:2.0:1788940490.024557:0:5883:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89f08417d100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89f191e3bd80 00000020:00080000:2.0:1788940490.024562:0:5883:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89f08417d500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89f1bfab3000 00000100:00100000:2.0:1788940490.024694:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788940490.024705:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf556a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3307:x1875839738258432:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788940490.024865:0:6707:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788940490.024869:0:6707:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788940491 00000100:00100000:1.0:1788940490.025048:0:6705:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1788940490.025058:0:6705:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000020:00080000:3.0:1788940490.025255:0:5894:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00002000:00010000:2.0:1788940490.025404:0:6707:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788940490.025406:0:6707:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788940490 -> 1788940491 00002000:00010000:2.0:1788940490.025408:0:6707:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788940490.025501:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf556a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3307:x1875839738258432:12345-0@lo:2:osp-syn-0-0.0 Request processed in 798us (1789us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788940490.025511:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:2.0:1788940490.026319:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788940490.026335:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788940490.026352:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1841db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738258688:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788940490.026399:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:2.0:1788940490.026476:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967401 is committed 00000020:00080000:2.0:1788940490.026498:0:5883:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89f198099000 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1788940490.026503:0:5883:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89f1a0244e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89f198099e40 00000020:00080000:2.0:1788940490.026506:0:5883:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89f1a0244000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89f1ae7c3800 00000020:00080000:2.0:1788940490.026548:0:5894:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1788940490.026744:0:5894:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1788940490.027338:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738258688 00000100:00100000:1.0:1788940490.027348:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738258688 00000100:00100000:1.0:1788940490.027398:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788940490.027409:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1841d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1875839738258688:12345-0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788940490.027423:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89f1bf555c00/2, rc 0, transno 4294967309 00000100:00100000:3.0:1788940490.027432:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf555c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738258432:0@lo:2:osp-syn-0-0.0 00002000:00080000:1.0:1788940490.027436:0:6708:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:1.0:1788940490.027482:0:6708:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa110ca, atime: 0x6aa110ca, ctime: 0x6aa110ca, blocks: 0x1 00010000:00010000:1.0:1788940490.027491:0:6708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075211af8/0x27a633fcdd4b36f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.027507:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=432s v=(0 0) 00010000:00010000:1.0:1788940490.027511:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940490.027542:0:6708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075211af8/0x27a633fcdd4b36f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.027559:0:6708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075211af8/0x27a633fcdd4b36f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.027570:0:6708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075211af8/0x27a633fcdd4b36f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.027578:0:6708:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075211af8/0x27a633fcdd4b36f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.027606:0:6708:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788940490.029188:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f184197b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+15:10562:x1875839718319488:12345-192.168.202.14@tcp:44:lhsmtool_posix.0 Request processed in 92598us (92841us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940490.029201:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 124 00000100:00100000:1.0:1788940490.029798:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1841d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3306:x1875839738258688:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2387us (3395us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788940490.029808:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:2.0:1788940490.030303:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89f1841db480/2, rc 0, transno 4294967304 00000100:00100000:2.0:1788940490.030313:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1841db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738258688:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788940490.030861:0:7649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940490.030873:0:7649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075211af8/0x27a633fcdd4b36f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.030887:0:7649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258c200 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:3.0:1788940490.030892:0:7649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075211af8/0x27a633fcdd4b36f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.030904:0:7649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075211af8/0x27a633fcdd4b36f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.030936:0:7649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075211af8/0x27a633fcdd4b36f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.030944:0:7649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075211af8/0x27a633fcdd4b36f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.030968:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940490.030970:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940490.030972:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940490.037048:0:7074:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf557100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7074:1875839738258560:192.168.202.14@tcp:104: 00010000:00010000:1.0:1788940490.037085:0:7074:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bf131944/0x27a633fcdd4b368 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940490.039722:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940490.039773:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940490.039875:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718319616 00000100:00100000:2.0:1788940490.039892:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718319616 00010000:00010000:2.0:1788940490.040021:0:8470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002cfe34ce/0x27a633fcdd4b12a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f588b expref: 12 pid: 6705 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940490.040073:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 56 00000100:00100000:2.0:1788940490.040103:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf557100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+12:2352:x1875839718319616:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788940490.040121:0:8470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940490.040127:0:8470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002cfe34ce/0x27a633fcdd4b12a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f588b expref: 12 pid: 6705 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.040142:0:8470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002cfe34ce/0x27a633fcdd4b12a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f588b expref: 12 pid: 6705 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.040170:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cfe34ce/0x27a633fcdd4b12a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f588b expref: 12 pid: 6705 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.040196:0:8470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00000100:00100000:3.0:1788940490.040197:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718319744 00000100:00100000:3.0:1788940490.040204:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718319744 00010000:00010000:2.0:1788940490.040205:0:8470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788940490.040214:0:8470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bf131944/0x27a633fcdd4b368 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.040226:0:8470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf131944/0x27a633fcdd4b368 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940490.040245:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 43 00000100:00100000:3.0:1788940490.040257:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf555f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+12:2352:x1875839718319744:12345-192.168.202.14@tcp:16:lhsmtool_posix.0 00010000:00010000:2.0:1788940490.040283:0:8470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940490.040363:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf557100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+12:2352:x1875839718319616:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 261us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940490.040371:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 56 00010000:00010000:2.0:1788940490.040402:0:7074:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bf131944/0x27a633fcdd4b368 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.040425:0:7074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf131944/0x27a633fcdd4b368 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.040435:0:7074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf131944/0x27a633fcdd4b368 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.040460:0:7074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf131944/0x27a633fcdd4b368 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.040478:0:7074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788940490.041240:0:7074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf556d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3307:x1875839738258304:12345-0@lo:6:osp-syn-0-0.0 Request processed in 17378us (17632us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788940490.041249:0:7074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:2.0:1788940490.041272:0:7648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940490.041281:0:7648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf131944/0x27a633fcdd4b368 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.041290:0:7648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258d800 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:2.0:1788940490.041295:0:7648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf131944/0x27a633fcdd4b368 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.041306:0:7648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf131944/0x27a633fcdd4b368 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.041324:0:7648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf131944/0x27a633fcdd4b368 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.041341:0:7648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf131944/0x27a633fcdd4b368 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.041359:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940490.041361:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940490.041363:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788940490.044682:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89f1bf555880/2, rc 0, transno 4294967310 00000100:00100000:3.0:1788940490.044722:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf555880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738258304:0@lo:6:osp-syn-0-0.0 00000100:00080000:0.0:1788940490.045376:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788940490.170486:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf555f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+11:2352:x1875839718319744:12345-192.168.202.14@tcp:16:lhsmtool_posix.0 Request processed in 130214us (130695us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940490.170506:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 43 00000001:00080000:2.0:1788940490.170600:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:2.0:1788940490.170616:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:2.0:1788940490.170626:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:2.0:1788940490.170634:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:1.0:1788940490.188167:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940490.191303:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718320000 00000100:00100000:3.0:1788940490.191321:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718320000 00000100:00100000:3.0:1788940490.191452:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 125 00000100:00100000:3.0:1788940490.191466:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f0821c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+15:10562:x1875839718320000:12345-192.168.202.14@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788940490.191561:0:7857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940490.191595:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b353 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f591e expref: 15 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.191618:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff89f18a6ce500) 00010000:00010000:3.0:1788940490.191623:0:7857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788940490.191653:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b376 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.191668:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b376 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.191679:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b376 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788940490.191946:0:7857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b9137880 reply state 00000000e2e5e952 transno 4294967402 ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b376 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940490.191956:0:7857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788940490.192097:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f0821c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+16:10562:x1875839718320000:12345-192.168.202.14@tcp:36:lhsmtool_posix.0 Request processed in 633us (3939us total) trans 4294967402 rc 0/0 00000100:00100000:3.0:1788940490.194085:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 125 00000100:00080000:0.0:1788940490.194188:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788940490.197012:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940490.197117:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718320128 00000100:00100000:2.0:1788940490.197129:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718320128 00000100:00100000:2.0:1788940490.197195:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 44 00000100:00100000:2.0:1788940490.197207:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f184194a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2353:x1875839718320128:12345-192.168.202.14@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788940490.197499:0:6708:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1788940490.197503:0:6708:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1788940491 -> 1788940490 00002000:00010000:2.0:1788940490.197506:0:6708:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788940490 00002000:00010000:2.0:1788940490.197508:0:6708:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788940491 -> 1788940490 00002000:00010000:2.0:1788940490.197510:0:6708:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788940490.197611:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f184194a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+7:2353:x1875839718320128:12345-192.168.202.14@tcp:2:lhsmtool_posix.0 Request processed in 405us (611us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788940490.197619:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 44 00010000:00010000:3.0:1788940490.199017:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b376 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.199054:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b376 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.199062:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b376 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.199068:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f180030400 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940490.199072:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b376 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.199080:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b376 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.199096:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff89f18a6ce500) 00010000:00010000:3.0:1788940490.199099:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940490.199105:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b376 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.199111:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b376 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940490.209861:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940490.210537:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718320384 00000100:00100000:2.0:1788940490.210552:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718320384 00000100:00100000:2.0:1788940490.210627:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 126 00000100:00100000:2.0:1788940490.210640:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+15:10562:x1875839718320384:12345-192.168.202.14@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788940490.210732:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b37d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.210752:0:5860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b337 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5910 expref: 15 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.210762:0:5860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b37d lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.210806:0:5860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b337 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5910 expref: 15 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.210822:0:5860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b337 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5910 expref: 15 pid: 5860 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940490.210841:0:5860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1841d9880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5860:1875839738258816:192.168.202.14@tcp:104: 00000100:00100000:2.0:1788940490.210950:0:5860:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f18de9e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940490.227663:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940490.227811:0:5860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1841d9880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5860:1875839738258816:192.168.202.14@tcp:104: 00010000:00010000:3.0:1788940490.227906:0:5860:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b37d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940490.228058:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718320512 00000100:00100000:1.0:1788940490.228068:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718320512 00010000:00010000:1.0:1788940490.228117:0:5845:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b337 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5910 expref: 16 pid: 5860 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940490.228169:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 57 00000100:00100000:1.0:1788940490.228181:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1841d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+16:2352:x1875839718320512:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788940490.228199:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940490.228208:0:5845:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b337 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5910 expref: 16 pid: 5860 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.228223:0:5845:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b337 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5910 expref: 16 pid: 5860 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.228252:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b337 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5910 expref: 16 pid: 5860 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.228274:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff89f18a6ce500) 00010000:00010000:1.0:1788940490.228281:0:5845:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b37d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.228317:0:5845:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b37d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.228325:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b37d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.228359:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940490.228420:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1841d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+15:2352:x1875839718320512:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 240us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940490.228429:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 57 00010000:00010000:3.0:1788940490.228737:0:5860:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b37d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.228746:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b37d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.228791:0:5860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b37d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.228798:0:5860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b37d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.228804:0:5860:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b37d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.228810:0:5860:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188daac00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940490.228816:0:5860:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b37d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.228824:0:5860:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b37d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.228835:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff89f18a6ce500) 00010000:00010000:3.0:1788940490.228838:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788940490.228843:0:5860:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b37d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.228848:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b37d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940490.228903:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+14:10562:x1875839718320384:12345-192.168.202.14@tcp:55:lhsmtool_posix.0 Request processed in 18265us (19051us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788940490.228911:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 126 00000100:00100000:0.0:1788940490.236995:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940490.241298:0:7074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718320640 00000100:00100000:2.0:1788940490.241319:0:7074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718320640 00000100:00100000:2.0:1788940490.241429:0:7074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 45 00000100:00100000:2.0:1788940490.241451:0:7074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f184195180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+7:2351:x1875839718320640:12345-192.168.202.14@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788940490.241515:0:7074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000817c3d73/0x27a633fcdd4b384 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.241604:0:7074:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002948a24c/0x27a633fcdd4b361 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f592c expref: 7 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.241612:0:7074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788940490.241616:0:7074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788940490.241621:0:7074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000817c3d73/0x27a633fcdd4b384 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.241668:0:7074:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002948a24c/0x27a633fcdd4b361 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f592c expref: 7 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.241684:0:7074:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002948a24c/0x27a633fcdd4b361 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f592c expref: 7 pid: 6708 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940490.241701:0:7074:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1841d9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7074:1875839738258944:192.168.202.14@tcp:104: 00000100:00100000:2.0:1788940490.241795:0:7074:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f18de9ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1788940490.254049:0:7074:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1841d9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7074:1875839738258944:192.168.202.14@tcp:104: 00000100:00100000:0.0:1788940490.254090:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00010000:00010000:2.0:1788940490.254092:0:7074:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000817c3d73/0x27a633fcdd4b384 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940490.258600:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718320768 00000100:00100000:1.0:1788940490.258619:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718320768 00010000:00010000:1.0:1788940490.258672:0:8470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002948a24c/0x27a633fcdd4b361 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f592c expref: 8 pid: 6708 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940490.258716:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 58 00000100:00100000:1.0:1788940490.258726:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f184194380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+8:2352:x1875839718320768:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788940490.258742:0:8470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940490.258766:0:8470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002948a24c/0x27a633fcdd4b361 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f592c expref: 8 pid: 6708 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.258780:0:8470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002948a24c/0x27a633fcdd4b361 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f592c expref: 8 pid: 6708 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.258808:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002948a24c/0x27a633fcdd4b361 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f592c expref: 8 pid: 6708 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.258848:0:8470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788940490.258853:0:8470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788940490.258859:0:8470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000817c3d73/0x27a633fcdd4b384 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.258869:0:8470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000817c3d73/0x27a633fcdd4b384 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.258906:0:8470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940490.258980:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f184194380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+7:2352:x1875839718320768:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 255us (4890us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940490.258989:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 58 00010000:00010000:2.0:1788940490.259358:0:7074:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000817c3d73/0x27a633fcdd4b384 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.259368:0:7074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000817c3d73/0x27a633fcdd4b384 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.259403:0:7074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000817c3d73/0x27a633fcdd4b384 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.259411:0:7074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000817c3d73/0x27a633fcdd4b384 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.259420:0:7074:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000817c3d73/0x27a633fcdd4b384 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.259427:0:7074:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188dab400 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:2.0:1788940490.259431:0:7074:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000817c3d73/0x27a633fcdd4b384 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.259449:0:7074:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000817c3d73/0x27a633fcdd4b384 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.259463:0:7074:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000817c3d73/0x27a633fcdd4b384 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.259470:0:7074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000817c3d73/0x27a633fcdd4b384 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940490.259581:0:7074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f184195180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2351:x1875839718320640:12345-192.168.202.14@tcp:1:lhsmtool_posix.0 Request processed in 18142us (22600us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940490.259589:0:7074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 45 00000100:00100000:0.0:1788940490.266354:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940490.266508:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718321024 00000100:00100000:2.0:1788940490.266556:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718321024 00000100:00100000:2.0:1788940490.266618:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 127 00000100:00100000:2.0:1788940490.266630:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b8bf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+14:10562:x1875839718321024:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788940490.266728:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4b38b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.266747:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4b38b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.266761:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4b38b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.267030:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4b392 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.267042:0:5862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b345 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5917 expref: 15 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.267051:0:5862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4b392 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.267097:0:5862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b345 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5917 expref: 15 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.267112:0:5862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b345 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5917 expref: 15 pid: 5860 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940490.267129:0:5862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1841d9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5862:1875839738259072:192.168.202.14@tcp:104: 00000100:00100000:2.0:1788940490.267714:0:5862:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f18de9ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1788940490.277634:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940490.277798:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718321152 00000100:00100000:1.0:1788940490.277809:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718321152 00000100:00100000:3.0:1788940490.277824:0:5862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1841d9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5862:1875839738259072:192.168.202.14@tcp:104: 00010000:00010000:1.0:1788940490.277858:0:5845:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b345 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5917 expref: 16 pid: 5860 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.277859:0:5862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4b392 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940490.277909:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 59 00000100:00100000:1.0:1788940490.277920:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1841d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+16:2352:x1875839718321152:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788940490.277940:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940490.277948:0:5845:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b345 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5917 expref: 16 pid: 5860 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.277975:0:5845:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b345 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5917 expref: 16 pid: 5860 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.278016:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b345 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5917 expref: 16 pid: 5860 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.278035:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff89f18a6ce500) 00010000:00010000:1.0:1788940490.278041:0:5845:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4b392 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.278052:0:5845:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4b392 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.278061:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4b392 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.278093:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788940490.278115:0:5862:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4b392 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.278122:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4b392 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940490.278514:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1841d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+15:2352:x1875839718321152:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 592us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940490.278548:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 59 00000001:00080000:2.0:1788940490.280726:0:5862:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1788940490.281171:0:5862:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:2.0:1788940490.281219:0:5862:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:2.0:1788940490.281331:0:5862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1841db100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5862:1875839738259200:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788940490.281411:0:5862:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940490.282818:0:5862:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1862c00c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788940490.282969:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738259200 00000100:00100000:3.0:1788940490.282981:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738259200 00000100:00100000:2.0:1788940490.283185:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788940490.283207:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1841db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5862:x1875839738259200:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788940490.283376:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1841db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5862:x1875839738259200:12345-0@lo:1000:mdt00_002.0 Request processed in 180us (1963us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940490.283384:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788940490.283743:0:5862:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1788940490.283751:0:5862:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:3.0:1788940490.283774:0:5862:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89f1bf555c00, transno 4294967309 00000004:00080000:3.0:1788940490.284002:0:5862:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89f1bf555880, transno 4294967310 00000100:00100000:3.0:1788940490.284012:0:5862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1841db100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5862:1875839738259200:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1788940490.290016:0:5862:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:3.0:1788940490.290166:0:5862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bfbda300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5862:1875839738259328:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788940490.290432:0:5862:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940490.290484:0:5862:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f18de9e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788940490.290756:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738259328 00000100:00100000:0.0:1788940490.290767:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738259328 00000100:00100000:0.0:1788940490.291094:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788940490.291107:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5862:x1875839738259328:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788940490.291432:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5862:x1875839738259328:12345-0@lo:1000:mdt00_002.0 Request processed in 326us (999us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1788940490.291467:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788940490.291598:0:5862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bfbda300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5862:1875839738259328:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1788940490.291641:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4b392 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.291654:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4b392 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.291662:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4b392 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.291669:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188daba00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940490.291681:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4b392 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.291691:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4b392 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.291717:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff89f18a6ce500) 00010000:00010000:3.0:1788940490.291720:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788940490.291726:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4b392 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.291732:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4b392 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.291772:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4b2d5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.291790:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4b2d5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.291797:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4b2d5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.291803:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258d000 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940490.291805:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4b2d5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.291811:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4b2d5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.291820:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89f188f81400) 00010000:00010000:3.0:1788940490.291822:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788940490.291837:0:5862:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4b2dc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58fb expref: 18 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.291850:0:5862:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4b2dc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58fb expref: 18 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.291859:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4b2dc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58fb expref: 18 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.291909:0:5862:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4b2dc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58fb expref: 18 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940490.291923:0:5862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bfbd9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5862:1875839738259456:192.168.202.14@tcp:105: 00000100:00100000:3.0:1788940490.292010:0:5862:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f18de9e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788940490.300562:0:5862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bfbd9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5862:1875839738259456:192.168.202.14@tcp:105: 00010000:00010000:1.0:1788940490.300609:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4b2d5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.300622:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4b2d5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.300671:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b399 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.300686:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b399 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.300700:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b399 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.300732:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b399 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.300737:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b399 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.300743:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b399 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.300748:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258c400 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940490.300752:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b399 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.300760:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b399 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.300773:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89f188f81400) 00010000:00010000:1.0:1788940490.300776:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940490.301032:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b399 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.301039:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b399 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.301050:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4b38b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.301055:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4b38b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.301060:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4b38b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.301073:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188dab400 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940490.301077:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4b38b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.301082:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4b38b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.301091:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89f188f81400) 00010000:00010000:1.0:1788940490.301094:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788940490.301097:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4b38b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.301101:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4b38b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940490.302471:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940490.303265:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b8bf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+18:10562:x1875839718321024:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 Request processed in 36629us (36920us total) trans 4294967407 rc 0/0 00000100:00100000:1.0:1788940490.303283:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 127 00000020:00080000:1.0:1788940490.303291:0:5862:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1788940490.304872:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718321280 00000100:00100000:2.0:1788940490.304887:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718321280 00000100:00100000:2.0:1788940490.304957:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 31 00000100:00100000:2.0:1788940490.304968:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+18:10561:x1875839718321280:12345-192.168.202.14@tcp:49:lfs.0 00000100:00100000:2.0:1788940490.305093:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+18:10561:x1875839718321280:12345-192.168.202.14@tcp:49:lfs.0 Request processed in 125us (2631us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940490.305100:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 31 00000040:00080000:3.0:1788940490.310706:0:11708:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788940490.310721:0:11708:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788940490.311254:0:11708:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1788940490.311266:0:11708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788940490.320104:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940490.322101:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718321536 00000100:00100000:2.0:1788940490.322122:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718321536 00000100:00100000:2.0:1788940490.322197:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 32 00000100:00100000:2.0:1788940490.322218:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b0612850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+18:10562:x1875839718321536:12345-192.168.202.14@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788940490.323154:0:5864:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788940490.323285:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967408 00010000:00010000:2.0:1788940490.323346:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b3a0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.323380:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b3a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.323396:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b3a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.323407:0:5864:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b3a0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.323414:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b3a0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.323421:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b3a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.323461:0:5864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788940490.334049:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b0612850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+20:10562:x1875839718321536:12345-192.168.202.14@tcp:35:lhsmtool_posix.0 Request processed in 11818us (13940us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1788940490.334066:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 32 00000020:00080000:2.0:1788940490.334077:0:5864:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788940490.334175:0:5848:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940490.334186:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b3a0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.334207:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188daac00 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:2.0:1788940490.334212:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b3a0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.334223:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b3a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.334263:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff89f186946a00) 00010000:00010000:2.0:1788940490.334266:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788940490.334272:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b3a0 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.334278:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b3a0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.334300:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940490.334302:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940490.334303:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940490.341581:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940490.341695:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718321792 00000100:00100000:1.0:1788940490.341707:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718321792 00000100:00100000:1.0:1788940490.341773:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 128 00000100:00100000:1.0:1788940490.341785:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f0821c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+20:10561:x1875839718321792:12345-192.168.202.14@tcp:58:lfs.0 00000040:00080000:1.0:1788940490.342084:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1788940490.342173:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f0821c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+20:10561:x1875839718321792:12345-192.168.202.14@tcp:58:lfs.0 Request processed in 390us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940490.342197:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 128 00000100:00100000:1.0:1788940490.402943:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940490.403036:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718321920 00000100:00100000:3.0:1788940490.403049:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718321920 00000100:00100000:3.0:1788940490.403122:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 129 00000100:00100000:3.0:1788940490.403135:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f0821c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+20:10564:x1875839718321920:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:3.0:1788940490.403169:0:7857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940490.403197:0:7857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b3a7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5933 expref: -99 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.403280:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b3ae lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.403313:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b3ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.403326:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b3ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.403343:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b3b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.403350:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b3b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.403356:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b3b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.403656:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b3bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.403667:0:7857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258cc00/0x27a633fcdd4b2c7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58f4 expref: 21 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.403675:0:7857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b3bc lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.403712:0:7857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258cc00/0x27a633fcdd4b2c7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58f4 expref: 21 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.403725:0:7857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258cc00/0x27a633fcdd4b2c7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58f4 expref: 21 pid: 5862 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940490.403754:0:7857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bfbd8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7857:1875839738259584:192.168.202.14@tcp:104: 00000100:00100000:3.0:1788940490.403853:0:7857:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f18de9e240 going to sleep for 11 seconds 00010000:00010000:3.0:1788940490.412799:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940490.428370:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940490.428471:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718322176 00000100:00100000:2.0:1788940490.428484:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718322176 00000100:00100000:2.0:1788940490.428582:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 33 00000100:00100000:2.0:1788940490.428594:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b8bf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+22:9966:x1875839718322176:12345-192.168.202.14@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788940490.428883:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b8bf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+23:9966:x1875839718322176:12345-192.168.202.14@tcp:35:ldlm_bl.0 Request processed in 290us (525us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1788940490.428905:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 33 00000100:00100000:3.0:1788940490.429084:0:7857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bfbd8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7857:1875839738259584:192.168.202.14@tcp:104: 00010000:00010000:3.0:1788940490.429121:0:7857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b3bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940490.432496:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940490.432632:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718322304 00000100:00100000:2.0:1788940490.432655:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718322304 00010000:00010000:2.0:1788940490.432716:0:8470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258cc00/0x27a633fcdd4b2c7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58f4 expref: 23 pid: 5862 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940490.432771:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 60 00000100:00100000:2.0:1788940490.432782:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1841b6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+23:2352:x1875839718322304:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788940490.432803:0:8470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940490.432811:0:8470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258cc00/0x27a633fcdd4b2c7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58f4 expref: 23 pid: 5862 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.432846:0:8470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258cc00/0x27a633fcdd4b2c7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58f4 expref: 23 pid: 5862 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.432871:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258cc00/0x27a633fcdd4b2c7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58f4 expref: 23 pid: 5862 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.432901:0:8470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89f188f81400) 00010000:00010000:2.0:1788940490.432908:0:8470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b3bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.432917:0:8470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b3bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.432926:0:8470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b3bc lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.432956:0:8470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940490.433025:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1841b6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+22:2352:x1875839718322304:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 244us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940490.433033:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 60 00010000:00010000:3.0:1788940490.434092:0:7857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b3bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.434109:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b3bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940490.434164:0:7857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788940490.434169:0:7857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788940490.434195:0:7857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b3bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.434973:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b3bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.434988:0:7857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b3ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.434996:0:7857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b3ae lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.435005:0:7857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b3ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.435040:0:7857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f180030000 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940490.435045:0:7857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b3ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.435053:0:7857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b3ae lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.435071:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89f188f81300) 00010000:00010000:3.0:1788940490.435075:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940490.435080:0:7857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b3ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.435087:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b3ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.435107:0:7857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b3b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.435113:0:7857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b3b5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.435118:0:7857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b3b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.435122:0:7857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f180031800 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940490.435125:0:7857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b3b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.435130:0:7857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b3b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.435149:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff89f18a6ce500) 00010000:00010000:3.0:1788940490.435151:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940490.435155:0:7857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b3b5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.435161:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b3b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.436028:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b3a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5933 expref: 22 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.436051:0:7857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b3bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5933 expref: 21 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.436060:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89f188f81400) 00010000:00010000:3.0:1788940490.436062:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788940490.436065:0:7857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f180030c00, rc 0) 00000100:00100000:2.0:1788940490.436489:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f0821c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+21:10564:x1875839718321920:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 33346us (33547us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940490.436500:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 129 00000040:00080000:1.0:1788940491.376488:0:11708:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788940491.376499:0:11708:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788940491.376651:0:11708:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788940491.376659:0:11708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788940491.376844:0:11708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c0380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11708:1875839738259712:192.168.202.14@tcp:107:hsm_cdtr.0 00000040:00080000:3.0:1788940491.377010:0:12133:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788940491.377014:0:12133:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788940491.377059:0:12133:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788940491.377064:0:12133:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788940491.377551:0:11708:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1a9664180 going to sleep for 11 seconds 00000100:00100000:0.0:1788940491.386798:0:11708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c0380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11708:1875839738259712:192.168.202.14@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788940491.399747:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940491.412140:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718322432 00000100:00100000:1.0:1788940491.412163:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718322432 00000100:00100000:1.0:1788940491.412408:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 130 00000100:00100000:1.0:1788940491.412422:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1841d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+21:10576:x1875839718322432:12345-192.168.202.14@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788940491.412476:0:5861:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788940491.412626:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1841d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+21:10576:x1875839718322432:12345-192.168.202.14@tcp:53:lhsmtool_posix.0 Request processed in 206us (12893us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940491.412635:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 130 00000100:00100000:3.0:1788940491.418024:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940491.418063:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718322688 00000100:00100000:3.0:1788940491.418075:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718322688 00000100:00100000:3.0:1788940491.418138:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 131 00000100:00100000:3.0:1788940491.418150:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+21:10576:x1875839718322688:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788940491.418178:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940491.418235:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b3c3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f593a expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940491.418365:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b3ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940491.418382:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b3ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940491.418397:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b3ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940491.418411:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788940491.418600:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b3c3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f593a expref: 24 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940491.418622:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b3ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f593a expref: 23 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940491.418630:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89f188f81400) 00010000:00010000:3.0:1788940491.418633:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788940491.418637:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f180031800, rc 0) 00000100:00100000:3.0:1788940491.418699:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+23:10576:x1875839718322688:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 551us (685us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1788940491.418707:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 131 00000100:00100000:0.0:1788940491.444742:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940491.446635:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940491.446708:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718323072 00000100:00100000:0.0:1788940491.446720:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718323072 00000100:00100000:0.0:1788940491.446788:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 9 00000100:00100000:0.0:1788940491.446799:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b8bf7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+23:2351:x1875839718323072:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940491.446817:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940491.446842:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b3ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f593a expref: 23 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940491.446860:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89f188f81400) 00010000:00010000:0.0:1788940491.446865:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940491.446921:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b8bf7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+22:2351:x1875839718323072:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 123us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940491.446928:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 9 00010000:00010000:0.0:1788940491.446952:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940491.458684:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718322944 00000100:00100000:1.0:1788940491.458700:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718322944 00000100:00100000:1.0:1788940491.458785:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 132 00000100:00100000:1.0:1788940491.458798:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b8bf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+22:10576:x1875839718322944:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788940491.458897:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4b3d8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940491.458918:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4b3d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940491.458944:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4b3d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940491.459146:0:5860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4b3d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940491.459155:0:5860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4b3d8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940491.459162:0:5860:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4b3d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940491.459169:0:5860:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258d800 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940491.459173:0:5860:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4b3d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940491.459181:0:5860:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4b3d8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940491.459195:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89f188f81400) 00010000:00010000:1.0:1788940491.459199:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788940491.459204:0:5860:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4b3d8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940491.459210:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4b3d8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940491.459401:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b8bf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+23:10576:x1875839718322944:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 Request processed in 604us (14665us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1788940491.459410:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 132 00000040:00080000:2.0:1788940491.460136:0:11708:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788940491.460143:0:11708:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788940491.460654:0:11708:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788940491.460674:0:11708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788940491.470969:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940491.475128:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718323328 00000100:00100000:2.0:1788940491.475144:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718323328 00000100:00100000:2.0:1788940491.475217:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 34 00000100:00100000:2.0:1788940491.475230:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f0821c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+23:10576:x1875839718323328:12345-192.168.202.14@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788940491.476146:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f0821c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+24:10576:x1875839718323328:12345-192.168.202.14@tcp:35:lhsmtool_posix.0 Request processed in 915us (5185us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1788940491.476158:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 34 00000100:00100000:1.0:1788940491.787503:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940491.787571:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940491.787596:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940491.787620:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940491.787641:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940491.787675:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718323584 00000100:00100000:1.0:1788940491.787688:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718323584 00000100:00100000:1.0:1788940491.787757:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718323968 00000100:00100000:1.0:1788940491.787760:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718323968 00000100:00100000:1.0:1788940491.788487:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 159 00000100:00100000:1.0:1788940491.788502:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f0821c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+24:2350:x1875839718323584:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788940491.788624:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f0821c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+24:2350:x1875839718323584:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 125us (1051us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940491.788632:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 159 00000100:00100000:1.0:1788940491.788652:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 160 00000100:00100000:1.0:1788940491.788660:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f0821c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffa310cd-169f-42e3-8999-506116bada08+5:2351:x1875839718323968:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788940491.788686:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f0821c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffa310cd-169f-42e3-8999-506116bada08+5:2351:x1875839718323968:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 27us (1044us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940491.788691:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 160 00000100:00080000:1.0:1788940491.789902:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940491.789959:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718323456 00000100:00100000:1.0:1788940491.789972:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718323456 00000100:00100000:1.0:1788940491.790028:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 301 00000100:00100000:1.0:1788940491.790038:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:2350:x1875839718323456:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788940491.790109:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:2350:x1875839718323456:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 62us (2607us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940491.790133:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 301 00000100:00100000:1.0:1788940491.790240:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718323712 00000100:00100000:1.0:1788940491.790244:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718323712 00000100:00100000:1.0:1788940491.790272:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718323840 00000100:00100000:1.0:1788940491.790275:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718323840 00000100:00100000:1.0:1788940491.790302:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 84 00000100:00100000:1.0:1788940491.790309:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f0821c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2351:x1875839718323712:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788940491.790343:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f0821c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2351:x1875839718323712:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 34us (2746us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940491.790349:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 84 00000100:00100000:1.0:1788940491.790361:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 85 00000100:00100000:1.0:1788940491.790367:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f0821c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+7:2351:x1875839718323840:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788940491.790392:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f0821c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+7:2351:x1875839718323840:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 25us (2771us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940491.790398:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 85 00000100:00080000:1.0:1788940491.790417:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1788940491.879297:0:7662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:3.0:1788940491.879315:0:7662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:3.0:1788940492.269503:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bfbda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875839738259968:0@lo:400:kworker.0 00000100:00100000:3.0:1788940492.269617:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940492.269712:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5831500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738260480:0@lo:400:kworker.0 00000100:00100000:3.0:1788940492.269742:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940492.269870:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bfbdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738260224:0@lo:400:kworker.0 00000100:00100000:0.0:1788940492.269925:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940492.270068:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bfbdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875839738260096:0@lo:400:kworker.0 00000100:00100000:1.0:1788940492.270105:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940492.270137:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738259968 00000100:00100000:1.0:1788940492.270146:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738259968 00000100:00100000:1.0:1788940492.270198:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738260096 00000100:00100000:1.0:1788940492.270201:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738260096 00000100:00100000:1.0:1788940492.270234:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788940492.270245:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5830700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875839738259968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940492.270304:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5830700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875839738259968:12345-0@lo:400:kworker.0 Request processed in 61us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940492.270321:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788940492.270340:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788940492.270347:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f0821c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875839738260096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940492.270383:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f0821c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875839738260096:12345-0@lo:400:kworker.0 Request processed in 37us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940492.270389:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788940492.270410:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738260480 00000100:00100000:1.0:1788940492.270414:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738260480 00000100:00100000:1.0:1788940492.270455:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738260224 00000100:00100000:1.0:1788940492.270459:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738260224 00000100:00100000:1.0:1788940492.270478:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788940492.270485:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5831880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738260480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940492.270539:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5831880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738260480:12345-0@lo:400:kworker.0 Request processed in 55us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940492.270546:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788940492.270558:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788940492.270565:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfae8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1875839738260224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940492.270603:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfae8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1875839738260224:12345-0@lo:400:kworker.0 Request processed in 38us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940492.270609:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:1.0:1788940492.270649:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788940492.270653:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788940492.270656:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940492.271057:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bfbd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3306:1875839738259840:0@lo:400:kworker.0 00000100:00100000:2.0:1788940492.271103:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940492.271307:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1788940492.271314:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:3.0:1788940492.271337:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89f1841db480, transno 4294967304 00000100:00100000:3.0:1788940492.271358:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5831500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738260480:0@lo:400:kworker.0 00000100:00100000:3.0:1788940492.271385:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bfbda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875839738259968:0@lo:400:kworker.0 00000100:00100000:1.0:1788940492.273994:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738259840 00000100:00100000:1.0:1788940492.274012:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738259840 00000100:00100000:1.0:1788940492.274094:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1788940492.274106:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3306:x1875839738259840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940492.274289:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3306:x1875839738259840:12345-0@lo:400:kworker.0 Request processed in 185us (3185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940492.274297:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1788940492.276839:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788940492.276867:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bfae8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738260608:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788940492.276973:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940492.277220:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bfbd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3306:1875839738259840:0@lo:400:kworker.0 00000100:00100000:2.0:1788940492.277229:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bfbd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875839738260352:0@lo:400:kworker.0 00000100:00100000:2.0:1788940492.277258:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940492.277328:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738260608 00000100:00100000:1.0:1788940492.277336:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738260608 00000100:00100000:1.0:1788940492.277396:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788940492.277407:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5831500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875839738260608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788940492.277461:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788940492.277505:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5831500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875839738260608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940492.277513:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788940492.277565:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738260352 00000100:00100000:1.0:1788940492.277569:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738260352 00000100:00100000:1.0:1788940492.277608:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788940492.277615:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1841db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875839738260352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940492.277648:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1841db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875839738260352:12345-0@lo:400:kworker.0 Request processed in 34us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940492.277655:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00080000:1.0:1788940492.277676:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788940492.281297:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bfbdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738260224:0@lo:400:kworker.0 00000100:00100000:3.0:1788940492.281459:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bfae8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738260608:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788940492.284003:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bfbdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875839738260096:0@lo:400:kworker.0 00000100:00100000:2.0:1788940492.284400:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bfbd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875839738260352:0@lo:400:kworker.0 00010000:00010000:3.0:1788940492.462179:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788940493.453994:0:12186:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788940493.454008:0:12186:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788940493.454060:0:12186:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788940493.454066:0:12186:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788940493.487671:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940493.660692:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940493.660747:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718324224 00000100:00100000:2.0:1788940493.660762:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718324224 00000100:00080000:1.0:1788940493.660851:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940493.660867:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 133 00000100:00100000:2.0:1788940493.660880:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf557100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+24:10597:x1875839718324224:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:2.0:1788940493.660907:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940493.660936:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4b3df lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5941 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940493.661073:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa800/0x27a633fcdd4b3e6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940493.661090:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa800/0x27a633fcdd4b3e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940493.661111:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa800/0x27a633fcdd4b3e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940493.661123:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788940493.661299:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4b3df lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5941 expref: 27 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940493.661323:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa800/0x27a633fcdd4b3e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5941 expref: 26 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940493.661334:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89f188f81400) 00010000:00010000:2.0:1788940493.661337:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788940493.661342:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f188daa800, rc 0) 00000100:00100000:2.0:1788940493.661433:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf557100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+26:10597:x1875839718324224:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 556us (759us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1788940493.661441:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 133 00000100:00100000:1.0:1788940493.666946:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940493.667048:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718324352 00000100:00100000:2.0:1788940493.667061:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718324352 00000100:00100000:2.0:1788940493.667131:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 134 00000100:00100000:2.0:1788940493.667151:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf555c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+26:10597:x1875839718324352:12345-192.168.202.14@tcp:54:lfs.0 00010000:00010000:2.0:1788940493.667230:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b3f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940493.667249:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b3f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940493.667263:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b3f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940493.667325:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b3f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940493.667333:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b3f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940493.667339:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b3f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940493.667345:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188daaa00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940493.667351:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b3f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940493.667360:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b3f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940493.667374:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89f188f81400) 00010000:00010000:2.0:1788940493.667378:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788940493.667384:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b3f4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940493.667390:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b3f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940493.667846:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf555c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+26:10597:x1875839718324352:12345-192.168.202.14@tcp:54:lfs.0 Request processed in 694us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940493.667855:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 134 00000100:00100000:1.0:1788940493.787144:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940493.787450:0:12095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718324480 00000100:00100000:0.0:1788940493.787463:0:12095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718324480 00000100:00100000:0.0:1788940493.787617:0:12095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 46 00000100:00080000:1.0:1788940493.787662:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788940493.788677:0:12095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf555880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2353:x1875839718324480:12345-192.168.202.14@tcp:101:cat.0 00010000:00010000:0.0:1788940493.788699:0:12095:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940493.788722:0:12095:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c74d2b5e/0x27a633fcdd4b3fb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5948 expref: -99 pid: 12095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788940493.788751:0:12095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa110ca, atime: 0x6aa110ca, ctime: 0x6aa110ca, blocks: 0xb 00010000:00010000:0.0:1788940493.788776:0:12095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=436s v=(0 0) 00010000:00010000:0.0:1788940493.788781:0:12095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940493.788791:0:12095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c74d2b5e/0x27a633fcdd4b3fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5948 expref: 7 pid: 12095 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940493.788811:0:12095:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c74d2b5e/0x27a633fcdd4b3fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5948 expref: 7 pid: 12095 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940493.788824:0:12095:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f082ad3c00, rc 0) 00000100:00100000:0.0:1788940493.789630:0:12095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf555880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9c51ff78-d02d-4e61-8a10-a2f8830f1679+7:2353:x1875839718324480:12345-192.168.202.14@tcp:101:cat.0 Request processed in 954us (2489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940493.789641:0:12095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 46 00000100:00100000:3.0:1788940493.802923:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940493.803102:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718324608 00000100:00100000:1.0:1788940493.803115:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718324608 00002000:00100000:1.0:1788940493.803203:0:6712:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff89f1bfbd9c00 x1875839718324608/t0(0) o3->9c51ff78-d02d-4e61-8a10-a2f8830f1679@192.168.202.14@tcp:469/0 lens 488/0 e 0 to 0 dl 1788940504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788940493.803215:0:6712:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89f1bfbd9c00 with x1875839718324608 ext(0->4095) 00002000:00010000:1.0:1788940493.803223:0:6712:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89f1bfbd9c00 00000100:00100000:1.0:1788940493.803336:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 3 00000100:00100000:1.0:1788940493.803349:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+7:2352:x1875839718324608:12345-192.168.202.14@tcp:3:cat.0 00000100:00100000:1.0:1788940493.803692:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+7:2352:x1875839718324608:12345-192.168.202.14@tcp:3:cat.0 Request processed in 345us (779us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788940493.803700:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 3 00002000:00100000:1.0:1788940493.803707:0:6712:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff89f1bfbd9c00 x1875839718324608/t0(0) o3->9c51ff78-d02d-4e61-8a10-a2f8830f1679@192.168.202.14@tcp:469/0 lens 488/4536 e 0 to 0 dl 1788940504 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788940493.803716:0:6712:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89f1bfbd9c00 with x1875839718324608 ext(0->4095) 00002000:00010000:1.0:1788940493.803719:0:6712:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89f1bfbd9c00 00000100:00100000:0.0:1788940493.805833:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae851500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738260736:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788940493.805917:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940493.806047:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738260736 00000100:00100000:1.0:1788940493.806057:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738260736 00000100:00100000:1.0:1788940493.806112:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788940493.806122:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfae9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738260736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788940493.806163:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788940493.806231:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfae9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738260736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940493.806238:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788940493.807293:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae851500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738260736:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788940494.508849:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788940495.450059:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000001:00080000:2.0:1788940495.450079:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:2.0:1788940495.450115:0:5883:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:2.0:1788940495.450134:0:5883:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89f190e43000 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1788940495.450139:0:5883:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89f19068c800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89f190e430c0 00000020:00080000:2.0:1788940495.450142:0:5883:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89f19068ca00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89f1ae7c0400 00000020:00080000:2.0:1788940495.450173:0:5894:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1788940495.450409:0:5894:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:0.0:1788940495.474256:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:0.0:1788940495.474280:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00010000:00010000:0.0:1788940495.543107:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940496.556712:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940496.896338:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940496.897311:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940496.897363:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940496.897407:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940496.897434:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940496.897474:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718325248 00000100:00100000:3.0:1788940496.897486:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718325248 00000100:00100000:3.0:1788940496.897578:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718324864 00000100:00100000:3.0:1788940496.897581:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718324864 00000100:00100000:3.0:1788940496.897611:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 164 00000100:00100000:3.0:1788940496.897622:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffa310cd-169f-42e3-8999-506116bada08+5:2353:x1875839718325248:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788940496.897716:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffa310cd-169f-42e3-8999-506116bada08+5:2353:x1875839718325248:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 95us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940496.897759:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 164 00000100:00100000:3.0:1788940496.897782:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 165 00000100:00100000:3.0:1788940496.897788:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+13:2353:x1875839718324864:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788940496.897816:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+13:2353:x1875839718324864:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 28us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940496.897822:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 165 00000100:00100000:2.0:1788940496.900675:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718324992 00000100:00100000:2.0:1788940496.900693:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718324992 00000100:00100000:2.0:1788940496.901280:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718325120 00000100:00100000:2.0:1788940496.901286:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718325120 00000100:00100000:2.0:1788940496.901326:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 88 00000100:00100000:2.0:1788940496.901338:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2353:x1875839718324992:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788940496.902372:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2353:x1875839718324992:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 1031us (5060us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940496.903267:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 88 00000100:00100000:2.0:1788940496.903307:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 89 00000100:00100000:2.0:1788940496.903319:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+5:2353:x1875839718325120:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788940496.903374:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+5:2353:x1875839718325120:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 59us (5938us total) trans 0 rc 0/0 00000100:00080000:1.0:1788940496.903960:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788940496.903968:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788940496.903972:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940496.906207:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 89 00000100:00100000:0.0:1788940496.907954:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718324736 00000100:00100000:0.0:1788940496.907971:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718324736 00000100:00100000:0.0:1788940496.908171:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 303 00000100:00100000:0.0:1788940496.908184:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:2353:x1875839718324736:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788940496.908263:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:2353:x1875839718324736:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 83us (11939us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940496.908272:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 303 00000100:00100000:3.0:1788940497.391389:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae7c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738260864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788940497.391422:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae851880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875839738261248:0@lo:400:kworker.0 00000100:00100000:2.0:1788940497.393896:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae853b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875839738261120:0@lo:400:kworker.0 00000100:00100000:3.0:1788940497.399098:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940497.399195:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738260864 00000100:00100000:0.0:1788940497.399214:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738260864 00000100:00100000:0.0:1788940497.399320:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788940497.399335:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae7c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738260864:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788940497.399344:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae851c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738261376:0@lo:400:kworker.0 00002000:00000024:0.0:1788940497.399395:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788940497.399422:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940497.399497:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae7c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738260864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 162us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940497.399506:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788940497.399510:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788940497.399550:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae852300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875839738261504:0@lo:400:kworker.0 00000100:00100000:3.0:1788940497.399592:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940497.399648:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738261504 00000100:00100000:3.0:1788940497.399654:0:12095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738261376 00000100:00100000:0.0:1788940497.399655:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738261504 00000100:00100000:3.0:1788940497.399666:0:12095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738261376 00000100:00100000:0.0:1788940497.399697:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788940497.399706:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae7ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875839738261504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940497.399755:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae7ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875839738261504:12345-0@lo:400:kworker.0 Request processed in 49us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940497.399762:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788940497.400118:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788940497.400446:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788940497.400453:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788940497.400843:0:12095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788940497.400858:0:12095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae7c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738261376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940497.400915:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940497.400946:0:12095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae7c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738261376:12345-0@lo:400:kworker.0 Request processed in 91us (1524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940497.403502:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae850380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738261632:0@lo:400:kworker.0 00000100:00100000:2.0:1788940497.403589:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940497.403633:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738261632 00000100:00100000:2.0:1788940497.403651:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738261632 00000100:00100000:2.0:1788940497.403711:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788940497.403721:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1841dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738261632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940497.403777:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1841dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738261632:12345-0@lo:400:kworker.0 Request processed in 58us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940497.403786:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788940497.404294:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738261248 00000100:00100000:0.0:1788940497.404301:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738261248 00000100:00100000:0.0:1788940497.404340:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738261120 00000100:00100000:0.0:1788940497.404343:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738261120 00000100:00100000:0.0:1788940497.404356:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788940497.404363:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae851500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875839738261248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940497.404433:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae851500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875839738261248:12345-0@lo:400:kworker.0 Request processed in 71us (4316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940497.404439:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788940497.404454:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788940497.404461:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1841d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875839738261120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940497.404488:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1841d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875839738261120:12345-0@lo:400:kworker.0 Request processed in 28us (3577us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940497.404494:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:1.0:1788940497.405358:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788940497.405366:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788940497.405422:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae851880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875839738261248:0@lo:400:kworker.0 00000100:00100000:1.0:1788940497.406351:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1788940497.406362:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:1.0:1788940497.406406:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae7c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738260864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788940497.406418:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae853800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3306:1875839738260992:0@lo:400:kworker.0 00000100:00100000:1.0:1788940497.406484:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940497.406841:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae853b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875839738261120:0@lo:400:kworker.0 00000100:00100000:2.0:1788940497.406856:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae850380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738261632:0@lo:400:kworker.0 00000100:00100000:3.0:1788940497.408273:0:12095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788940497.408337:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae852300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875839738261504:0@lo:400:kworker.0 00000100:00100000:3.0:1788940497.408351:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738260992 00000100:00100000:2.0:1788940497.408361:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae851c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738261376:0@lo:400:kworker.0 00000100:00100000:3.0:1788940497.408364:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738260992 00000100:00100000:3.0:1788940497.408444:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1788940497.408456:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3306:x1875839738260992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940497.408634:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3306:x1875839738260992:12345-0@lo:400:kworker.0 Request processed in 180us (2148us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940497.408645:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1788940497.408671:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae853800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3306:1875839738260992:0@lo:400:kworker.0 00010000:00010000:3.0:1788940497.587779:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940498.605512:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940498.925303:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae851880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738261760:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788940498.925415:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940498.925505:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738261760 00000100:00100000:1.0:1788940498.925515:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738261760 00000100:00100000:1.0:1788940498.925597:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788940498.925607:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae853800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738261760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788940498.925651:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788940498.925700:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae853800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738261760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940498.926018:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788940498.926079:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae851880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738261760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788940499.602663:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940499.607041:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718325376 00000100:00100000:0.0:1788940499.607062:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718325376 00000100:00100000:0.0:1788940499.607176:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 135 00000100:00100000:0.0:1788940499.607193:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae7c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+13:10241:x1875839718325376:12345-192.168.202.14@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788940499.607338:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae7c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+13:10241:x1875839718325376:12345-192.168.202.14@tcp:60:lhsmtool_posix.0 Request processed in 151us (4684us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940499.607346:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 135 00000100:00080000:1.0:1788940499.608007:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788940499.609937:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940499.616560:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718325632 00000100:00100000:2.0:1788940499.616579:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718325632 00000100:00100000:3.0:1788940499.616832:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 35 00000100:00100000:3.0:1788940499.616846:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfae8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+13:10241:x1875839718325632:12345-192.168.202.14@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788940499.617309:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfae8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+14:10241:x1875839718325632:12345-192.168.202.14@tcp:35:lhsmtool_posix.0 Request processed in 464us (7385us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1788940499.617317:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 35 00010000:00010000:2.0:1788940499.629269:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940500.161189:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940500.161415:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718325760 00000100:00100000:1.0:1788940500.161429:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718325760 00000100:00100000:1.0:1788940500.161555:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 136 00000100:00100000:1.0:1788940500.161569:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfaeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffa310cd-169f-42e3-8999-506116bada08+5:11049:x1875839718325760:12345-192.168.202.14@tcp:101:lsof.0 00010000:00010000:1.0:1788940500.161594:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940500.161618:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b402 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f594f expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788940500.161818:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788940500.162087:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ce00/0x27a633fcdd4b409 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940500.162104:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ce00/0x27a633fcdd4b409 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940500.162118:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ce00/0x27a633fcdd4b409 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940500.162162:0:5860:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788940500.162166:0:5860:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788940500.162209:0:5860:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ce00/0x27a633fcdd4b409 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940500.162236:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b402 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f594f expref: 7 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940500.162256:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ce00/0x27a633fcdd4b409 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f594f expref: 6 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940500.162263:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f1983af400) 00010000:00010000:1.0:1788940500.162282:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788940500.162286:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f19258ce00, rc 0) 00000100:00100000:1.0:1788940500.162410:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfaeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffa310cd-169f-42e3-8999-506116bada08+6:11049:x1875839718325760:12345-192.168.202.14@tcp:101:lsof.0 Request processed in 845us (1239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940500.162418:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 136 00000020:00080000:2.0:1788940500.536160:0:5883:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:2.0:1788940500.536194:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:3.0:1788940500.536245:0:5894:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1788940500.536256:0:5894:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:0.0:1788940500.658562:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788940501.676847:0:11708:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788940501.676859:0:11708:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788940501.677257:0:11708:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 2 00000040:00080000:1.0:1788940501.677265:0:11708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788940501.677961:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940502.012341:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940502.012391:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940502.012428:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940502.012456:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940502.012482:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940502.012604:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718326400 00000100:00100000:3.0:1788940502.012628:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718326400 00000100:00100000:3.0:1788940502.012702:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718326016 00000100:00100000:3.0:1788940502.012706:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718326016 00000100:00100000:3.0:1788940502.012734:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 169 00000100:00100000:3.0:1788940502.012745:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf69dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffa310cd-169f-42e3-8999-506116bada08+6:2351:x1875839718326400:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788940502.013013:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf69dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffa310cd-169f-42e3-8999-506116bada08+6:2351:x1875839718326400:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 268us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940502.013022:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 169 00000100:00100000:3.0:1788940502.013040:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 170 00000100:00100000:3.0:1788940502.013046:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf69f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+13:2351:x1875839718326016:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788940502.013075:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf69f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+13:2351:x1875839718326016:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 29us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940502.013099:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 170 00000100:00100000:1.0:1788940502.013550:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718325888 00000100:00100000:1.0:1788940502.013557:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718325888 00000100:00100000:1.0:1788940502.013586:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 305 00000100:00100000:1.0:1788940502.013593:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:2351:x1875839718325888:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788940502.013641:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:2351:x1875839718325888:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 48us (1320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940502.013664:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 305 00000100:00100000:1.0:1788940502.013700:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718326144 00000100:00100000:1.0:1788940502.013704:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718326144 00000100:00100000:1.0:1788940502.013730:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718326272 00000100:00100000:1.0:1788940502.013733:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718326272 00000100:00100000:1.0:1788940502.013754:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 92 00000100:00100000:1.0:1788940502.013759:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfae8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2351:x1875839718326144:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788940502.013796:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfae8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2351:x1875839718326144:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 25us (1394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940502.013802:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 92 00000100:00100000:1.0:1788940502.013813:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 93 00000100:00100000:1.0:1788940502.013819:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf69d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+5:2351:x1875839718326272:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788940502.013851:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf69d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+5:2351:x1875839718326272:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 32us (1367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940502.013858:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 93 00000100:00080000:0.0:1788940502.014606:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788940502.014621:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788940502.014633:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940502.511557:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1841da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875839738262144:0@lo:400:kworker.0 00000100:00100000:2.0:1788940502.511648:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940502.511719:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788940502.511727:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1841d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738262272:0@lo:400:kworker.0 00000100:00100000:2.0:1788940502.511755:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940502.512702:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1841daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875839738262016:0@lo:400:kworker.0 00000100:00100000:1.0:1788940502.512753:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940502.512814:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1841dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3305:1875839738261888:0@lo:400:kworker.0 00000100:00100000:1.0:1788940502.512856:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1841d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738262528:0@lo:400:kworker.0 00000100:00100000:2.0:1788940502.515248:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae7cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738262656:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788940502.517650:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940502.517776:0:12095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738262272 00000100:00100000:3.0:1788940502.517973:0:12095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738262272 00000100:00100000:3.0:1788940502.518054:0:12095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788940502.518066:0:12095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1841d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738262272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940502.518136:0:12095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1841d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738262272:12345-0@lo:400:kworker.0 Request processed in 72us (6379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940502.518143:0:12095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788940502.518168:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738262144 00000100:00100000:3.0:1788940502.518172:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738262144 00000100:00100000:3.0:1788940502.518198:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738262016 00000100:00100000:3.0:1788940502.518201:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738262016 00000100:00100000:3.0:1788940502.518221:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788940502.518227:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1841d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875839738262144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940502.518263:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1841d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875839738262144:12345-0@lo:400:kworker.0 Request processed in 36us (6616us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940502.518269:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788940502.518289:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788940502.518294:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae851880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875839738262016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940502.518337:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae851880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875839738262016:12345-0@lo:400:kworker.0 Request processed in 42us (5583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940502.518342:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788940502.519814:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940502.519914:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1841daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875839738262016:0@lo:400:kworker.0 00000100:00100000:1.0:1788940502.519961:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738262528 00000100:00100000:1.0:1788940502.519968:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738262528 00000100:00100000:1.0:1788940502.520016:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788940502.520024:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae851c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738262528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940502.520086:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae851c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738262528:12345-0@lo:400:kworker.0 Request processed in 62us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940502.520093:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788940502.520123:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1841d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738262528:0@lo:400:kworker.0 00000100:00080000:3.0:1788940502.520196:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788940502.520202:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788940502.520206:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788940502.520346:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1841da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875839738262400:0@lo:400:kworker.0 00000100:00100000:0.0:1788940502.520383:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940502.520416:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738262400 00000100:00100000:0.0:1788940502.520420:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738262400 00000100:00100000:0.0:1788940502.520453:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788940502.520459:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf69d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875839738262400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940502.520495:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf69d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875839738262400:12345-0@lo:400:kworker.0 Request processed in 37us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940502.520501:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788940502.520553:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1841da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875839738262400:0@lo:400:kworker.0 00000100:00100000:0.0:1788940502.520777:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738261888 00000100:00100000:0.0:1788940502.520782:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738261888 00000100:00100000:0.0:1788940502.520812:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1788940502.520819:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1840c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3305:x1875839738261888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940502.520857:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1840c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3305:x1875839738261888:12345-0@lo:400:kworker.0 Request processed in 39us (3214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940502.520863:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1788940502.520898:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1841dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3305:1875839738261888:0@lo:400:kworker.0 00000100:00100000:2.0:1788940502.521027:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940502.521074:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1841d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738262272:0@lo:400:kworker.0 00000100:00100000:2.0:1788940502.521104:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1841da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875839738262144:0@lo:400:kworker.0 00000100:00080000:3.0:1788940502.521214:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788940502.521264:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738262656 00000100:00100000:0.0:1788940502.521268:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738262656 00000100:00100000:0.0:1788940502.521301:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788940502.521309:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1841dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738262656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788940502.521448:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788940502.521504:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1841dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738262656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 196us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940502.521722:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae7cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738262656:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788940502.521789:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00010000:3.0:1788940502.701164:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940503.726166:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940504.046451:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788940504.046480:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae852300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738262784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788940504.046573:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940504.046645:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738262784 00000100:00100000:1.0:1788940504.046655:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738262784 00000100:00100000:1.0:1788940504.046871:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788940504.046882:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae850380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738262784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788940504.046920:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788940504.046983:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae850380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738262784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940504.046990:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788940504.047049:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae852300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738262784:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788940504.047103:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:2.0:1788940504.481165:0:12389:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 03:55:04 (1788940504) 00010000:00010000:2.0:1788940504.759490:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940505.772759:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940506.253670:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940506.253880:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718326656 00000100:00100000:3.0:1788940506.253894:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718326656 00000100:00100000:3.0:1788940506.253992:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 137 00000100:00100000:3.0:1788940506.254005:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae852300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+13:11315:x1875839718326656:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788940506.254028:0:7857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940506.254063:0:7857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b410 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5956 expref: -99 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940506.254140:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b417 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940506.254154:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b417 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940506.254166:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b417 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940506.254180:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b41e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940506.254186:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b41e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940506.254193:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b41e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940506.254449:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b425 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940506.254458:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b425 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940506.254475:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b425 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940506.254487:0:7857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1788940506.254663:0:7857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b417 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940506.254670:0:7857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b417 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940506.254676:0:7857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b417 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940506.254680:0:7857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f180030000 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940506.254685:0:7857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b417 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940506.254691:0:7857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b417 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940506.254702:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff89f188f81800) 00010000:00010000:3.0:1788940506.254705:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940506.254709:0:7857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b417 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940506.254715:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b417 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940506.254727:0:7857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b41e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940506.254732:0:7857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b41e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940506.254743:0:7857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b41e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940506.254748:0:7857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f180031600 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940506.254751:0:7857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b41e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940506.254757:0:7857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b41e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940506.254765:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff89f18a6ce200) 00010000:00010000:3.0:1788940506.254767:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940506.254770:0:7857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b41e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940506.254775:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b41e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940506.255169:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b410 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5956 expref: 16 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940506.255186:0:7857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b425 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5956 expref: 15 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940506.255194:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89f186946200) 00010000:00010000:3.0:1788940506.255196:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940506.255199:0:7857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f180030a00, rc 0) 00000100:00100000:3.0:1788940506.255289:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae852300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+15:11315:x1875839718326656:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 1286us (1629us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1788940506.255322:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 137 00000100:00080000:0.0:1788940506.255513:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788940506.261114:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940506.261159:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940506.261409:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718326912 00000100:00100000:2.0:1788940506.261422:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718326912 00000100:00100000:2.0:1788940506.261498:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 138 00000100:00100000:2.0:1788940506.261511:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf69c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+15:11315:x1875839718326912:12345-192.168.202.14@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788940506.261671:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf69c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+15:11315:x1875839718326912:12345-192.168.202.14@tcp:59:lhsmtool_posix.0 Request processed in 163us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940506.261679:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 138 00000100:00100000:1.0:1788940506.261967:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718326784 00000100:00100000:1.0:1788940506.261973:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718326784 00000100:00100000:1.0:1788940506.262021:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 10 00000100:00100000:1.0:1788940506.262030:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf69d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+15:2350:x1875839718326784:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788940506.262053:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940506.262082:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b425 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5956 expref: 15 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940506.262103:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89f186946200) 00010000:00010000:1.0:1788940506.262109:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940506.262141:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf69d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+14:2350:x1875839718326784:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 112us (1036us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940506.262148:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 10 00000040:00080000:0.0:1788940506.796767:0:11708:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788940506.796777:0:11708:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788940506.796825:0:11708:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 2 00000040:00080000:0.0:1788940506.796832:0:11708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788940506.796917:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940507.129172:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940507.129212:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940507.129253:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940507.129279:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940507.129318:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940507.129347:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718327552 00000100:00100000:0.0:1788940507.129359:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718327552 00000100:00100000:0.0:1788940507.129420:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718327168 00000100:00100000:0.0:1788940507.129423:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718327168 00000100:00100000:0.0:1788940507.129442:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 174 00000100:00100000:0.0:1788940507.129452:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4cd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffa310cd-169f-42e3-8999-506116bada08+6:2351:x1875839718327552:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788940507.129560:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4cd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffa310cd-169f-42e3-8999-506116bada08+6:2351:x1875839718327552:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 109us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940507.129568:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 174 00000100:00100000:0.0:1788940507.129588:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 175 00000100:00100000:0.0:1788940507.129595:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4cd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+14:2351:x1875839718327168:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788940507.129635:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4cd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+14:2351:x1875839718327168:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 40us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940507.129642:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 175 00000100:00100000:0.0:1788940507.129660:0:12095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718327296 00000100:00100000:0.0:1788940507.129663:0:12095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718327296 00000100:00100000:0.0:1788940507.129684:0:12095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718327424 00000100:00100000:0.0:1788940507.129687:0:12095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718327424 00000100:00100000:0.0:1788940507.129705:0:12095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 96 00000100:00100000:0.0:1788940507.129710:0:12095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf69c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2351:x1875839718327296:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788940507.129737:0:12095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf69c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2351:x1875839718327296:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 27us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940507.129758:0:12095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 96 00000100:00100000:0.0:1788940507.129770:0:12095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 97 00000100:00100000:0.0:1788940507.129776:0:12095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4cd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9c51ff78-d02d-4e61-8a10-a2f8830f1679+5:2351:x1875839718327424:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788940507.129799:0:12095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4cd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9c51ff78-d02d-4e61-8a10-a2f8830f1679+5:2351:x1875839718327424:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 23us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940507.129805:0:12095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 97 00000100:00080000:0.0:1788940507.129823:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788940507.129827:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788940507.129829:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788940507.130972:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718327040 00000100:00100000:3.0:1788940507.130984:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718327040 00000100:00100000:3.0:1788940507.131043:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 307 00000100:00100000:3.0:1788940507.131052:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18416d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:2351:x1875839718327040:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788940507.131115:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18416d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:2351:x1875839718327040:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 64us (1951us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940507.131122:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 307 00000100:00100000:2.0:1788940507.628728:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1841da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875839738263168:0@lo:400:kworker.0 00000100:00100000:2.0:1788940507.628823:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940507.628893:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788940507.628899:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1841d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738263296:0@lo:400:kworker.0 00000100:00100000:2.0:1788940507.628928:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940507.628966:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738263296 00000100:00100000:2.0:1788940507.628975:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738263296 00000100:00100000:2.0:1788940507.629037:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788940507.629045:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1841d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738263296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940507.629102:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1841d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738263296:12345-0@lo:400:kworker.0 Request processed in 58us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940507.629110:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788940507.629153:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1841d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738263296:0@lo:400:kworker.0 00000100:00100000:1.0:1788940507.629249:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1841d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875839738263040:0@lo:400:kworker.0 00000100:00100000:1.0:1788940507.629294:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940507.629324:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1841db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738263552:0@lo:400:kworker.0 00000100:00100000:1.0:1788940507.629358:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940507.629379:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788940507.629385:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1841da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3306:1875839738262912:0@lo:400:kworker.0 00000100:00100000:1.0:1788940507.629419:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940507.629442:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1841daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875839738263424:0@lo:400:kworker.0 00000100:00100000:1.0:1788940507.629498:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940507.629572:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738263552 00000100:00100000:1.0:1788940507.629577:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738263552 00000100:00100000:1.0:1788940507.629612:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788940507.629619:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738263552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940507.629656:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738263552:12345-0@lo:400:kworker.0 Request processed in 38us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940507.629662:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788940507.629696:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1841db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738263552:0@lo:400:kworker.0 00000100:00100000:2.0:1788940507.629917:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738263168 00000100:00100000:2.0:1788940507.629922:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738263168 00000100:00100000:2.0:1788940507.630032:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738263040 00000100:00100000:2.0:1788940507.630036:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738263040 00000100:00100000:2.0:1788940507.630047:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738263424 00000100:00100000:2.0:1788940507.630049:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738263424 00000100:00100000:2.0:1788940507.630064:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788940507.630069:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1841d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875839738263168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940507.630118:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1841d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875839738263168:12345-0@lo:400:kworker.0 Request processed in 48us (1296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940507.630125:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788940507.630136:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788940507.630141:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae853b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875839738263040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940507.630174:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae853b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875839738263040:12345-0@lo:400:kworker.0 Request processed in 33us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940507.630180:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788940507.630191:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788940507.630196:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1baadc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875839738263424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940507.630222:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1baadc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875839738263424:12345-0@lo:400:kworker.0 Request processed in 25us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940507.630227:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788940507.630262:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1841da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875839738263168:0@lo:400:kworker.0 00000100:00100000:2.0:1788940507.630304:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1841daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875839738263424:0@lo:400:kworker.0 00000100:00100000:2.0:1788940507.630317:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1841d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875839738263040:0@lo:400:kworker.0 00000100:00100000:2.0:1788940507.630667:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae7c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738263680:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788940507.630724:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940507.630810:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738263680 00000100:00100000:1.0:1788940507.630815:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738263680 00000100:00100000:1.0:1788940507.630855:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788940507.630863:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1841d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738263680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788940507.630898:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788940507.630953:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1841d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738263680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940507.630960:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:0.0:1788940507.631103:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788940507.631110:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788940507.631113:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788940507.631135:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738262912 00000100:00100000:0.0:1788940507.631140:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738262912 00000100:00100000:0.0:1788940507.631175:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1788940507.631183:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18416f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3306:x1875839738262912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940507.631234:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18416f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3306:x1875839738262912:12345-0@lo:400:kworker.0 Request processed in 52us (1813us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940507.631240:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1788940507.631490:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1841da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3306:1875839738262912:0@lo:400:kworker.0 00000100:00100000:3.0:1788940507.631654:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae7c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738263680:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788940507.826095:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940508.834189:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940508.837653:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718327680 00000100:00100000:2.0:1788940508.838009:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718327680 00000100:00100000:2.0:1788940508.838181:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 139 00000100:00100000:2.0:1788940508.838195:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae7c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+14:11358:x1875839718327680:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:2.0:1788940508.838236:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940508.838265:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4b433 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f595d expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940508.838377:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4b43a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940508.838397:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4b43a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940508.844144:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4b43a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940508.844215:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b441 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940508.844232:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b441 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940508.844241:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b441 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940508.844607:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4b43a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940508.844620:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4b43a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940508.844637:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4b43a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940508.844645:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188dab800 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940508.844652:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4b43a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940508.844662:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4b43a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940508.844689:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f1983af400) 00010000:00010000:2.0:1788940508.844693:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940508.844699:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4b43a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940508.844706:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4b43a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940508.845005:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b441 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940508.845014:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b441 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940508.845020:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b441 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940508.845027:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188daaa00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940508.845031:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b441 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940508.845050:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b441 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940508.845058:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff89f186946e00) 00010000:00010000:2.0:1788940508.845061:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940508.845064:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b441 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940508.845070:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b441 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940508.845129:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4b433 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f595d expref: 15 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940508.845141:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f1983af400) 00010000:00010000:2.0:1788940508.845143:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940508.845147:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4b433 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f595d expref: 15 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940508.845158:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f188dab600, rc 0) 00000100:00100000:2.0:1788940508.846076:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae7c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+14:11358:x1875839718327680:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 7876us (11897us total) trans 0 rc 301/301 00000100:00100000:2.0:1788940508.846090:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 139 00010000:00010000:1.0:1788940508.848686:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788940508.852579:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940508.857503:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940508.857718:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718327936 00000100:00100000:3.0:1788940508.857733:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718327936 00000100:00100000:3.0:1788940508.857801:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 140 00000100:00100000:3.0:1788940508.857812:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1841daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+14:11358:x1875839718327936:12345-192.168.202.14@tcp:36:lfs.0 00010000:00010000:3.0:1788940508.857895:0:7857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940508.857935:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3400/0x27a633fcdd4adb1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5796 expref: 14 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940508.857957:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f1983af400) 00010000:00010000:3.0:1788940508.857964:0:7857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788940508.858293:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b448 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940508.858313:0:7857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ce00/0x27a633fcdd4b409 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f594f expref: 5 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940508.858343:0:7857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b448 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940508.858389:0:7857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ce00/0x27a633fcdd4b409 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f594f expref: 5 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940508.858420:0:7857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ce00/0x27a633fcdd4b409 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f594f expref: 5 pid: 5860 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940508.858439:0:7857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae7caa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7857:1875839738263808:192.168.202.14@tcp:104: 00000100:00100000:3.0:1788940508.858606:0:7857:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1bf5b4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788940508.862032:0:7857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae7caa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7857:1875839738263808:192.168.202.14@tcp:104: 00010000:00010000:3.0:1788940508.862081:0:7857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b448 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940508.862561:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940508.862947:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718328064 00000100:00100000:3.0:1788940508.862957:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718328064 00010000:00010000:3.0:1788940508.863003:0:5845:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ce00/0x27a633fcdd4b409 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f594f expref: 6 pid: 5860 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940508.863049:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 61 00000100:00100000:3.0:1788940508.863060:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1841da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ffa310cd-169f-42e3-8999-506116bada08+6:2352:x1875839718328064:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940508.863076:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940508.863085:0:5845:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ce00/0x27a633fcdd4b409 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f594f expref: 6 pid: 5860 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940508.863120:0:5845:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ce00/0x27a633fcdd4b409 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f594f expref: 6 pid: 5860 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940508.863148:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ce00/0x27a633fcdd4b409 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f594f expref: 6 pid: 5860 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940508.863169:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f1983af400) 00010000:00010000:3.0:1788940508.863175:0:5845:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b448 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940508.863185:0:5845:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b448 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940508.863194:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b448 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940508.863347:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940508.863415:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1841da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ffa310cd-169f-42e3-8999-506116bada08+5:2352:x1875839718328064:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 356us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940508.863434:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 61 00010000:00010000:1.0:1788940508.867337:0:7857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b448 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940508.867372:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b448 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940508.867834:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4b44f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940508.867855:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4b44f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940508.867884:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4b44f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940508.875621:0:7857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788940508.875653:0:7857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b448 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940508.875683:0:7857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b448 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940508.875694:0:7857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b448 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940508.875702:0:7857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f180031600 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940508.875708:0:7857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b448 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940508.875718:0:7857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b448 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940508.876276:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f1983af400) 00010000:00010000:1.0:1788940508.876280:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940508.876288:0:7857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b448 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940508.876296:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b448 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788940508.876328:0:7857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006b406d5f reply state 00000000635cbe38 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4b44f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940508.876365:0:7857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788940508.876633:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1841daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+15:11358:x1875839718327936:12345-192.168.202.14@tcp:36:lfs.0 Request processed in 18816us (19139us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1788940508.876644:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 140 00010000:00010000:3.0:1788940508.881567:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4b44f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940508.881593:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4b44f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940508.881603:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4b44f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940508.881636:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258c600 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940508.881643:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4b44f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940508.881653:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4b44f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940508.882308:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff89f188f81c00) 00010000:00010000:3.0:1788940508.882314:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940508.882321:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4b44f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940508.882329:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4b44f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940509.007036:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940509.014620:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718328192 00000100:00100000:3.0:1788940509.014647:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718328192 00000100:00100000:2.0:1788940509.014869:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 141 00000100:00100000:2.0:1788940509.014882:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1841d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+14:11366:x1875839718328192:12345-192.168.202.14@tcp:101:lctl.0 00010000:00010000:2.0:1788940509.014934:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940509.014961:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4b456 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5964 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940509.015039:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daae00/0x27a633fcdd4b45d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940509.015055:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daae00/0x27a633fcdd4b45d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940509.015067:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daae00/0x27a633fcdd4b45d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940509.015110:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788940509.015113:0:5861:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788940509.015140:0:5861:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daae00/0x27a633fcdd4b45d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940509.015167:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4b456 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5964 expref: 16 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940509.015187:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daae00/0x27a633fcdd4b45d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5964 expref: 15 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940509.015196:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f186946e00) 00010000:00010000:2.0:1788940509.015199:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788940509.015204:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f188daae00, rc 0) 00000100:00100000:2.0:1788940509.015295:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1841d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+15:11366:x1875839718328192:12345-192.168.202.14@tcp:101:lctl.0 Request processed in 415us (8275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940509.015302:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 141 00000100:00100000:1.0:1788940509.102593:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940509.102812:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718328320 00000100:00100000:0.0:1788940509.102826:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718328320 00000100:00100000:0.0:1788940509.102906:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 142 00000100:00100000:0.0:1788940509.102918:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1baadd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+15:11372:x1875839718328320:12345-192.168.202.14@tcp:101:bash.0 00010000:00010000:0.0:1788940509.102962:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940509.103001:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3400/0x27a633fcdd4b464 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f596b expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940509.103094:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b46b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940509.103113:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b46b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940509.103128:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b46b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940509.103145:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b472 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940509.103163:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b472 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940509.103169:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b472 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940509.103314:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3200/0x27a633fcdd4b479 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940509.103323:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3200/0x27a633fcdd4b479 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940509.103331:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3200/0x27a633fcdd4b479 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940509.103365:0:5860:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788940509.103370:0:5860:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788940509.103393:0:5860:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3200/0x27a633fcdd4b479 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940509.103407:0:5860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b46b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940509.104240:0:5860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b46b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940509.104275:0:5860:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b46b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940509.104283:0:5860:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad2800 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:0.0:1788940509.104288:0:5860:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b46b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940509.104298:0:5860:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b46b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940509.104317:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f186946e00) 00010000:00010000:0.0:1788940509.104338:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940509.104345:0:5860:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b46b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940509.104352:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b46b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940509.104379:0:5860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b472 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940509.104387:0:5860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b472 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940509.104392:0:5860:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b472 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940509.104397:0:5860:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad2600 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:0.0:1788940509.104400:0:5860:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b472 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940509.104407:0:5860:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b472 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940509.104415:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff89f1983afa00) 00010000:00010000:0.0:1788940509.104418:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940509.104421:0:5860:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b472 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940509.104428:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b472 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940509.104488:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3400/0x27a633fcdd4b464 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f596b expref: 17 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940509.105046:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3200/0x27a633fcdd4b479 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f596b expref: 16 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940509.105060:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89f1983af600) 00010000:00010000:0.0:1788940509.105062:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788940509.105065:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f082ad3200, rc 0) 00000100:00100000:1.0:1788940509.105654:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1baadd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+16:11372:x1875839718328320:12345-192.168.202.14@tcp:101:bash.0 Request processed in 2723us (3062us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940509.105668:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 142 00000100:00100000:1.0:1788940509.109462:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940509.109656:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718328576 00000100:00100000:2.0:1788940509.109669:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718328576 00000100:00100000:2.0:1788940509.109738:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 143 00000100:00100000:2.0:1788940509.109749:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1baadd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+16:11372:x1875839718328576:12345-192.168.202.14@tcp:101:bash.0 00010000:00010000:2.0:1788940509.109777:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940509.109818:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4b480 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5972 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940509.110065:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b487 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940509.110084:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b487 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940509.110108:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b487 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940509.119977:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b48e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940509.120014:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b48e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940509.120031:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b48e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788940509.120728:0:5861:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:3.0:1788940509.120916:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b495 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940509.120927:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b495 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940509.120944:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b495 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940509.120988:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b487 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940509.120996:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b487 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940509.121002:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b487 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940509.121008:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188daac00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940509.121013:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b487 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940509.121021:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b487 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940509.121034:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89f1983af600) 00010000:00010000:3.0:1788940509.121038:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940509.121044:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b487 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940509.121050:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b487 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788940509.121063:0:5861:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004b7621aa reply state 0000000042f1d283 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b48e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940509.121071:0:5861:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788940509.121121:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4b480 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5972 expref: 19 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940509.121139:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b495 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5972 expref: 18 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940509.121147:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89f18a6ce000) 00010000:00010000:3.0:1788940509.121149:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788940509.121152:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f180030000, rc 0) 00000100:00100000:3.0:1788940509.121238:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1baadd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+19:11372:x1875839718328576:12345-192.168.202.14@tcp:101:bash.0 Request processed in 11491us (11792us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1788940509.121248:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 143 00010000:00010000:3.0:1788940509.127470:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b48e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940509.127488:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b48e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940509.127496:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b48e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940509.127502:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f180030400 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940509.127507:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b48e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940509.127532:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b48e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940509.127552:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff89f18a6ce700) 00010000:00010000:3.0:1788940509.127556:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940509.127582:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b48e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940509.127590:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b48e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940509.130252:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940509.130344:0:7074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718328704 00000100:00100000:2.0:1788940509.130356:0:7074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718328704 00000100:00100000:2.0:1788940509.130429:0:7074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 47 00000100:00100000:2.0:1788940509.130439:0:7074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1baadc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+5:2353:x1875839718328704:12345-192.168.202.14@tcp:101:bash.0 00010000:00010000:2.0:1788940509.130459:0:7074:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940509.130479:0:7074:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000817c3d73/0x27a633fcdd4b4a3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5979 expref: -99 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788940509.130506:0:7074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940509.130567:0:7074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1788940509.130572:0:7074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940509.130581:0:7074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000817c3d73/0x27a633fcdd4b4a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5979 expref: 6 pid: 7074 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940509.130630:0:7074:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000817c3d73/0x27a633fcdd4b4a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5979 expref: 6 pid: 7074 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940509.130646:0:7074:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f188dab400, rc 0) 00000100:00080000:3.0:1788940509.130682:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788940509.130701:0:7074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1baadc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2353:x1875839718328704:12345-192.168.202.14@tcp:101:bash.0 Request processed in 264us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940509.130706:0:7074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 47 00000100:00100000:2.0:1788940509.134068:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940509.134143:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718328832 00000100:00100000:1.0:1788940509.134155:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718328832 00000100:00100000:1.0:1788940509.134245:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 48 00000100:00100000:1.0:1788940509.134257:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1841da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:11372:x1875839718328832:12345-192.168.202.14@tcp:101:bash.0 00010000:00010000:1.0:1788940509.134286:0:6708:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940509.134306:0:6708:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b35c2fd/0x27a633fcdd4b4aa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5980 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940509.134342:0:6708:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000817c3d73/0x27a633fcdd4b4a3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5979 expref: 7 pid: 7074 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940509.134352:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940509.134357:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940509.134363:0:6708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b35c2fd/0x27a633fcdd4b4aa lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5980 expref: 7 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940509.134414:0:6708:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000817c3d73/0x27a633fcdd4b4a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5979 expref: 7 pid: 7074 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940509.134429:0:6708:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000817c3d73/0x27a633fcdd4b4a3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5979 expref: 7 pid: 7074 timeout: 552 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940509.134445:0:6708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1baadf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6708:1875839738263936:192.168.202.14@tcp:104: 00000100:00100000:1.0:1788940509.134574:0:6708:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1862ea240 going to sleep for 11 seconds 00000100:00100000:1.0:1788940509.144208:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940509.144326:0:6708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1baadf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6708:1875839738263936:192.168.202.14@tcp:104: 00010000:00010000:2.0:1788940509.144363:0:6708:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008b35c2fd/0x27a633fcdd4b4aa lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5980 expref: 7 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940509.144385:0:6708:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f19258dc00, rc 0) 00000100:00100000:2.0:1788940509.144508:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1841da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+7:11372:x1875839718328832:12345-192.168.202.14@tcp:101:bash.0 Request processed in 10253us (10449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940509.144563:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 48 00000100:00100000:0.0:1788940509.145014:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718328960 00000100:00100000:0.0:1788940509.145025:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718328960 00010000:00010000:0.0:1788940509.145069:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000817c3d73/0x27a633fcdd4b4a3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5979 expref: 7 pid: 7074 timeout: 552 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940509.145801:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 62 00000100:00100000:1.0:1788940509.145820:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1baaddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+7:2353:x1875839718328960:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788940509.145838:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940509.145864:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000817c3d73/0x27a633fcdd4b4a3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5979 expref: 7 pid: 7074 timeout: 552 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940509.145894:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000817c3d73/0x27a633fcdd4b4a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5979 expref: 7 pid: 7074 timeout: 552 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940509.145921:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000817c3d73/0x27a633fcdd4b4a3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5979 expref: 7 pid: 7074 timeout: 552 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940509.145948:0:5847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940509.145953:0:5847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940509.145982:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008b35c2fd/0x27a633fcdd4b4aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5980 expref: 6 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940509.146002:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b35c2fd/0x27a633fcdd4b4aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5980 expref: 6 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940509.146045:0:5847:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008b35c2fd/0x27a633fcdd4b4aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5980 expref: 6 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940509.146060:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1baadd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5847:1875839738264064:192.168.202.14@tcp:105: 00000100:00100000:1.0:1788940509.146152:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1862ea540 going to sleep for 11 seconds 00000100:00100000:1.0:1788940509.153611:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1baadd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5847:1875839738264064:192.168.202.14@tcp:105: 00010000:00010000:1.0:1788940509.153646:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940509.153733:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1baaddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2353:x1875839718328960:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 7918us (9536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940509.153745:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 62 00000100:00100000:3.0:1788940509.158434:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940509.158831:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718329216 00000100:00100000:1.0:1788940509.158845:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718329216 00000100:00100000:1.0:1788940509.158922:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 36 00000100:00100000:1.0:1788940509.159146:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae7caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+18:11372:x1875839718329216:12345-192.168.202.14@tcp:35:bash.0 00000100:00100000:0.0:1788940509.162480:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae7caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+19:11372:x1875839718329216:12345-192.168.202.14@tcp:35:bash.0 Request processed in 3533us (4041us total) trans 4294967419 rc 0/0 00000100:00100000:0.0:1788940509.162498:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 36 00000100:00100000:3.0:1788940509.164747:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788940509.164772:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1baadd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738264192:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788940509.164845:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940509.165008:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738264192 00000100:00100000:1.0:1788940509.165020:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738264192 00000100:00100000:1.0:1788940509.165101:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788940509.165111:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae7c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738264192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788940509.165151:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788940509.165207:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae7c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738264192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940509.165231:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788940509.165293:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1baadd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738264192:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788940509.165420:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788940509.289021:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940509.289130:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718329472 00000100:00100000:1.0:1788940509.289145:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718329472 00000100:00100000:1.0:1788940509.289220:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 144 00000100:00100000:1.0:1788940509.289238:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1841db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+19:11382:x1875839718329472:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:1.0:1788940509.289278:0:7857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940509.289305:0:7857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258cc00/0x27a633fcdd4b4b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5987 expref: -99 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940509.289416:0:7857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788940509.290333:0:7857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258cc00/0x27a633fcdd4b4b1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5987 expref: 21 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940509.290350:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f186946e00) 00010000:00010000:1.0:1788940509.290353:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788940509.290358:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258cc00/0x27a633fcdd4b4b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5987 expref: 21 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940509.290374:0:7857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f19258cc00, rc 0) 00000100:00100000:1.0:1788940509.291154:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1841db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+20:11382:x1875839718329472:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 1918us (2138us total) trans 4294967420 rc 301/301 00000100:00100000:1.0:1788940509.291164:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 144 00000100:00100000:3.0:1788940509.301665:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940509.301708:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718329728 00000100:00100000:3.0:1788940509.301968:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718329728 00000100:00100000:3.0:1788940509.302039:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 37 00000100:00100000:3.0:1788940509.302050:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae7cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+20:11382:x1875839718329728:12345-192.168.202.14@tcp:35:lfs.0 00000100:00100000:3.0:1788940509.302655:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae7cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+21:11382:x1875839718329728:12345-192.168.202.14@tcp:35:lfs.0 Request processed in 605us (997us total) trans 4294967421 rc 0/0 00000100:00100000:3.0:1788940509.302663:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 37 00000100:00100000:3.0:1788940509.470682:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940509.470798:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718329856 00000100:00100000:2.0:1788940509.470818:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718329856 00000100:00100000:2.0:1788940509.470911:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 145 00000100:00100000:2.0:1788940509.470925:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae7c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+21:11388:x1875839718329856:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:2.0:1788940509.470955:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940509.470979:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b4bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f598e expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940509.471069:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4b4c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940509.471082:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4b4c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940509.471095:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4b4c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940509.471129:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788940509.471133:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788940509.471151:0:5862:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4b4c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940509.471175:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b4bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f598e expref: 23 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940509.471196:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4b4c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f598e expref: 22 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940509.471204:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89f1983af600) 00010000:00010000:2.0:1788940509.471207:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788940509.471211:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f188daba00, rc 0) 00000100:00100000:2.0:1788940509.471396:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae7c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+22:11388:x1875839718329856:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 472us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940509.471404:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 145 00000100:00100000:0.0:1788940509.476417:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940509.477478:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718330112 00000100:00100000:2.0:1788940509.477496:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718330112 00000100:00100000:2.0:1788940509.477628:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 146 00000100:00100000:2.0:1788940509.477642:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+22:11388:x1875839718330112:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:2.0:1788940509.477828:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940509.477858:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b4cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5995 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940509.478008:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4b4d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940509.478028:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4b4d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940509.478043:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4b4d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940509.478058:0:5860:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788940509.478255:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b4cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5995 expref: 25 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940509.478290:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4b4d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5995 expref: 24 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940509.478300:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89f18a6ce000) 00010000:00010000:2.0:1788940509.478304:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788940509.478309:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f188dab400, rc 0) 00000100:00100000:2.0:1788940509.478632:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+24:11388:x1875839718330112:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 990us (2227us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1788940509.478641:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 146 00000100:00100000:3.0:1788940509.481637:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940509.482241:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718330240 00000100:00100000:0.0:1788940509.482258:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718330240 00000100:00100000:0.0:1788940509.482370:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 11 00000100:00100000:0.0:1788940509.482382:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f191023480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+24:2351:x1875839718330240:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940509.482403:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940509.482436:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4b4d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5995 expref: 24 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940509.482465:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89f18a6ce000) 00010000:00010000:0.0:1788940509.482472:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940509.482636:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f191023480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+23:2351:x1875839718330240:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 255us (1014us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940509.482645:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 11 00000100:00100000:0.0:1788940509.484673:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940509.484818:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718330496 00000100:00100000:3.0:1788940509.484830:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718330496 00000100:00100000:3.0:1788940509.484898:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 147 00000100:00100000:3.0:1788940509.484910:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+23:11388:x1875839718330496:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:3.0:1788940509.484944:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940509.484969:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b4e2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f599c expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940509.485139:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b4e9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940509.485159:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b4e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940509.485174:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b4e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940509.485190:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788940509.485388:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b4e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f599c expref: 26 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940509.485413:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b4e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f599c expref: 25 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940509.485422:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89f18a6ce000) 00010000:00010000:3.0:1788940509.485425:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788940509.485429:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f180031600, rc 0) 00000100:00100000:3.0:1788940509.487621:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+25:11388:x1875839718330496:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 2692us (2943us total) trans 4294967423 rc 0/0 00000100:00100000:3.0:1788940509.487639:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 147 00000100:00100000:1.0:1788940509.492461:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940509.492653:0:12095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718330624 00000100:00100000:0.0:1788940509.492667:0:12095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718330624 00000100:00100000:0.0:1788940509.492838:0:12095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 49 00000100:00100000:0.0:1788940509.492851:0:12095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1baadd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2353:x1875839718330624:12345-192.168.202.14@tcp:1:lfs.0 00010000:00010000:0.0:1788940509.492910:0:12095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000912f2fa4/0x27a633fcdd4b4f7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940509.492938:0:12095:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008b35c2fd/0x27a633fcdd4b4aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5980 expref: 6 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940509.492948:0:12095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940509.492954:0:12095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788940509.492959:0:12095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000912f2fa4/0x27a633fcdd4b4f7 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940509.493007:0:12095:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008b35c2fd/0x27a633fcdd4b4aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5980 expref: 6 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940509.493035:0:12095:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008b35c2fd/0x27a633fcdd4b4aa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5980 expref: 6 pid: 6708 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940509.493053:0:12095:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4f65880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12095:1875839738264320:192.168.202.14@tcp:104: 00000100:00100000:0.0:1788940509.493186:0:12095:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f182a4c480 going to sleep for 11 seconds 00000100:00100000:0.0:1788940509.498377:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940509.498705:0:12095:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4f65880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12095:1875839738264320:192.168.202.14@tcp:104: 00010000:00010000:1.0:1788940509.498756:0:12095:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000912f2fa4/0x27a633fcdd4b4f7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940509.498916:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718330752 00000100:00100000:3.0:1788940509.498926:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718330752 00002000:00100000:3.0:1788940509.498992:0:6712:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff89f1b4f65500 x1875839718330752/t0(0) o4->9c51ff78-d02d-4e61-8a10-a2f8830f1679@192.168.202.14@tcp:485/0 lens 504/0 e 0 to 0 dl 1788940520 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788940509.499004:0:6712:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89f1b4f65500 with x1875839718330752 ext(0->12) 00010000:00010000:3.0:1788940509.499018:0:6712:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008b35c2fd/0x27a633fcdd4b4aa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5980 expref: 7 pid: 6708 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940509.499045:0:6712:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008b35c2fd/0x27a633fcdd4b4aa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5980 expref: 7 pid: 6708 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788940509.499055:0:6712:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff89f1b4f65500 00000100:00100000:3.0:1788940509.499089:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 2 00000100:00100000:3.0:1788940509.499099:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+7:2352:x1875839718330752:12345-192.168.202.14@tcp:4:lfs.0 00000100:00100000:3.0:1788940509.500881:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+9:2352:x1875839718330752:12345-192.168.202.14@tcp:4:lfs.0 Request processed in 1767us (2504us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788940509.500896:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 2 00002000:00100000:3.0:1788940509.500909:0:6712:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff89f1b4f65500 x1875839718330752/t4294967305(0) o4->9c51ff78-d02d-4e61-8a10-a2f8830f1679@192.168.202.14@tcp:485/0 lens 504/448 e 0 to 0 dl 1788940520 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788940509.500921:0:6712:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89f1b4f65500 with x1875839718330752 ext(0->12) 00010000:00010000:3.0:1788940509.500933:0:6712:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008b35c2fd/0x27a633fcdd4b4aa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5980 expref: 9 pid: 6708 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940509.500955:0:6712:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008b35c2fd/0x27a633fcdd4b4aa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5980 expref: 9 pid: 6708 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788940509.500964:0:6712:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff89f1b4f65500 00000100:00100000:0.0:1788940509.508899:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940509.509174:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718330880 00000100:00100000:2.0:1788940509.509205:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718330880 00010000:00010000:2.0:1788940509.509271:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008b35c2fd/0x27a633fcdd4b4aa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5980 expref: 9 pid: 6708 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940509.509316:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 63 00000100:00100000:2.0:1788940509.509327:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f64a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+9:2353:x1875839718330880:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788940509.509365:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788940509.509393:0:5846:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788940509.509396:0:5846:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788940510 00002000:00010000:2.0:1788940509.509399:0:5846:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788940510 00002000:00010000:2.0:1788940509.509401:0:5846:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788940510 00010000:00010000:2.0:1788940509.509409:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008b35c2fd/0x27a633fcdd4b4aa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5980 expref: 9 pid: 6708 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940509.509425:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008b35c2fd/0x27a633fcdd4b4aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5980 expref: 9 pid: 6708 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940509.509455:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b35c2fd/0x27a633fcdd4b4aa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5980 expref: 9 pid: 6708 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940509.509477:0:5846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788940509.509482:0:5846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788940509.509490:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000912f2fa4/0x27a633fcdd4b4f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940509.509501:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000912f2fa4/0x27a633fcdd4b4f7 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940509.509600:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940509.509681:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f64a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+8:2353:x1875839718330880:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 354us (1345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940509.509689:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 63 00010000:00010000:0.0:1788940509.509820:0:12095:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000912f2fa4/0x27a633fcdd4b4f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940509.509832:0:12095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000912f2fa4/0x27a633fcdd4b4f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940509.509866:0:12095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000912f2fa4/0x27a633fcdd4b4f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940509.509876:0:12095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000912f2fa4/0x27a633fcdd4b4f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940509.509884:0:12095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000912f2fa4/0x27a633fcdd4b4f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940509.509893:0:12095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad2000 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:0.0:1788940509.509898:0:12095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000912f2fa4/0x27a633fcdd4b4f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940509.509909:0:12095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000912f2fa4/0x27a633fcdd4b4f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940509.509923:0:12095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000912f2fa4/0x27a633fcdd4b4f7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940509.509946:0:12095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000912f2fa4/0x27a633fcdd4b4f7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940509.510010:0:12095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1baadd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9c51ff78-d02d-4e61-8a10-a2f8830f1679+7:2353:x1875839718330624:12345-192.168.202.14@tcp:1:lfs.0 Request processed in 17162us (17566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940509.510019:0:12095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 49 00000100:00100000:0.0:1788940509.529184:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940509.529504:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718331136 00000100:00100000:2.0:1788940509.529538:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718331136 00000100:00100000:2.0:1788940509.529616:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 38 00000100:00100000:2.0:1788940509.529628:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b0610850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+25:11388:x1875839718331136:12345-192.168.202.14@tcp:35:lfs.0 00000004:00010000:2.0:1788940509.529720:0:5864:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b4e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f599c expref: 25 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788940509.530059:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1788940509.530113:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:2.0:1788940509.531107:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00010000:00010000:2.0:1788940509.531193:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4b4fe lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940509.531217:0:5864:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b495 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5972 expref: 29 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940509.531226:0:5864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4b4fe lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940509.531286:0:5864:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b495 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5972 expref: 29 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940509.531306:0:5864:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b495 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5972 expref: 29 pid: 5861 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940509.531337:0:5864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bff63100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5864:1875839738264448:192.168.202.14@tcp:104: 00000100:00100000:2.0:1788940509.531878:0:5864:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1813709c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788940509.551186:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940509.551688:0:5864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bff63100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5864:1875839738264448:192.168.202.14@tcp:104: 00010000:00010000:0.0:1788940509.551739:0:5864:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4b4fe lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940509.551877:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718331264 00000100:00100000:1.0:1788940509.551887:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718331264 00010000:00010000:1.0:1788940509.551935:0:5845:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b495 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5972 expref: 30 pid: 5861 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940509.551982:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 64 00000100:00100000:1.0:1788940509.551993:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1841b7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+30:2352:x1875839718331264:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788940509.552013:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940509.552032:0:5845:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b495 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5972 expref: 30 pid: 5861 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940509.552047:0:5845:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b495 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5972 expref: 30 pid: 5861 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940509.552073:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b495 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5972 expref: 30 pid: 5861 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940509.552094:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89f18a6ce000) 00010000:00010000:1.0:1788940509.552100:0:5845:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4b4fe lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940509.552111:0:5845:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4b4fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940509.552120:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4b4fe lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940509.552176:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940509.552250:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1841b7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+29:2352:x1875839718331264:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 258us (1080us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940509.552258:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 64 00010000:00010000:0.0:1788940509.553003:0:5864:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4b4fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940509.553015:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4b4fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788940509.553196:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000001:00080000:1.0:1788940509.555973:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:1.0:1788940509.560225:0:5864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1baaddf80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5864:1875839738264576:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788940509.560341:0:5864:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940509.560379:0:5864:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f183f1fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788940509.562808:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738264576 00000100:00100000:0.0:1788940509.562829:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738264576 00000100:00100000:0.0:1788940509.562922:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788940509.562936:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1baadc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5864:x1875839738264576:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788940509.563110:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1baadc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5864:x1875839738264576:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 177us (2769us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940509.563119:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788940509.563309:0:5864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1baaddf80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5864:1875839738264576:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788940509.566197:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:1.0:1788940509.566912:0:5864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1baaddf80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5864:1875839738264704:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788940509.567005:0:5864:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940509.567208:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738264704 00000100:00100000:0.0:1788940509.567233:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738264704 00000100:00100000:0.0:1788940509.567309:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788940509.567320:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1baaddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5864:x1875839738264704:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788940509.579894:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1baaddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5864:x1875839738264704:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 12558us (12871us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788940509.579916:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788940509.581187:0:5864:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1862ea240 going to sleep for 11 seconds 00000100:00100000:1.0:1788940509.581254:0:5864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1baaddf80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5864:1875839738264704:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788940509.581403:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:1.0:1788940509.581491:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4b4fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940509.581504:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4b4fe lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940509.581512:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4b4fe lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940509.581537:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188daa400 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940509.581543:0:5864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4b4fe lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940509.581572:0:5864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4b4fe lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940509.581592:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89f18a6ce000) 00010000:00010000:1.0:1788940509.581595:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788940509.581601:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4b4fe lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940509.581608:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4b4fe lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788940509.584439:0:5864:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788940509.584635:0:5864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:1.0:1788940509.584652:0:5864:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 452483132913ns, next at 453483129085ns, rc = 0 00000001:00080000:1.0:1788940509.584665:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:1.0:1788940509.584755:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89f18a6ce000) 00010000:00010000:1.0:1788940509.584761:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788940509.584775:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b4e9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f599c expref: 33 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940509.584947:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b0610850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+32:11388:x1875839718331136:12345-192.168.202.14@tcp:35:lfs.0 Request processed in 55320us (55778us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1788940509.584958:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 38 00000020:00080000:1.0:1788940509.584965:0:5864:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788940509.593924:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940509.594424:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718331392 00000100:00100000:1.0:1788940509.594437:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718331392 00000100:00100000:1.0:1788940509.594539:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 148 00000100:00100000:1.0:1788940509.594552:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f191023100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+32:11388:x1875839718331392:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:1.0:1788940509.594607:0:7857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940509.594637:0:7857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4b505 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f59a3 expref: -99 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940509.594728:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4b505 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f59a3 expref: 33 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940509.594746:0:7857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4b505 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f59a3 expref: 33 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940509.594771:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89f188f81100) 00010000:00010000:1.0:1788940509.594775:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788940509.594781:0:7857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f19258c200, rc 0) 00000100:00100000:1.0:1788940509.594864:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f191023100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+33:11388:x1875839718331392:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 315us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940509.594872:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 148 00000100:00100000:0.0:1788940509.598227:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940509.598429:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718331648 00000100:00100000:3.0:1788940509.598444:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718331648 00000100:00100000:3.0:1788940509.598566:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 39 00000100:00100000:3.0:1788940509.598578:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+33:11388:x1875839718331648:12345-192.168.202.14@tcp:35:lfs.0 00000100:00100000:3.0:1788940509.598935:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+34:11388:x1875839718331648:12345-192.168.202.14@tcp:35:lfs.0 Request processed in 359us (721us total) trans 4294967433 rc 0/0 00000100:00100000:3.0:1788940509.598944:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 39 00000100:00100000:0.0:1788940509.773742:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940509.773967:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718331904 00000100:00100000:2.0:1788940509.773981:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718331904 00000100:00100000:2.0:1788940509.774059:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 149 00000100:00100000:2.0:1788940509.774070:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+34:11398:x1875839718331904:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:2.0:1788940509.774118:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940509.774145:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b50c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f59aa expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940509.774278:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788940509.774453:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b50c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f59aa expref: 36 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940509.774474:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f186946e00) 00010000:00010000:2.0:1788940509.774478:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788940509.774486:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b50c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f59aa expref: 36 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940509.774507:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f188daac00, rc 0) 00000100:00100000:2.0:1788940509.774666:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+35:11398:x1875839718331904:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 597us (938us total) trans 4294967434 rc 301/301 00000100:00100000:2.0:1788940509.774674:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 149 00000100:00100000:0.0:1788940509.783428:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940509.784559:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718332032 00000100:00100000:1.0:1788940509.784577:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718332032 00000100:00100000:1.0:1788940509.784666:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 150 00000100:00100000:1.0:1788940509.784677:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+35:11398:x1875839718332032:12345-192.168.202.14@tcp:34:lfs.0 00010000:00010000:1.0:1788940509.784802:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4b51a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940509.784825:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4b51a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940509.784840:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4b51a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940509.784879:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4b521 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940509.784887:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4b521 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940509.784894:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4b521 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940509.785017:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258cc00/0x27a633fcdd4b528 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940509.785026:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258cc00/0x27a633fcdd4b528 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940509.785034:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258cc00/0x27a633fcdd4b528 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788940509.785093:0:7857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258cc00/0x27a633fcdd4b528 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940509.785121:0:7857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4b51a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940509.785129:0:7857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4b51a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940509.785137:0:7857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4b51a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940509.785144:0:7857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258d400 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940509.785150:0:7857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4b51a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940509.785167:0:7857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4b51a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940509.785182:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89f1983af600) 00010000:00010000:1.0:1788940509.785186:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940509.785193:0:7857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4b51a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940509.785200:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4b51a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940509.785213:0:7857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4b521 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940509.785219:0:7857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4b521 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940509.785226:0:7857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4b521 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940509.785231:0:7857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258dc00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940509.785234:0:7857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4b521 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940509.785241:0:7857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4b521 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940509.785249:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff89f188f81900) 00010000:00010000:1.0:1788940509.785252:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940509.785255:0:7857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4b521 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940509.785282:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4b521 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940509.785302:0:7857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258cc00/0x27a633fcdd4b528 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940509.785309:0:7857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258cc00/0x27a633fcdd4b528 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940509.785315:0:7857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258cc00/0x27a633fcdd4b528 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940509.785321:0:7857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258cc00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940509.785324:0:7857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258cc00/0x27a633fcdd4b528 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940509.785332:0:7857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258cc00/0x27a633fcdd4b528 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940509.785340:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89f188f81100) 00010000:00010000:1.0:1788940509.785342:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940509.785346:0:7857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258cc00/0x27a633fcdd4b528 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940509.785352:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258cc00/0x27a633fcdd4b528 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940509.785463:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+35:11398:x1875839718332032:12345-192.168.202.14@tcp:34:lfs.0 Request processed in 785us (2047us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940509.785474:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 150 00000100:00100000:1.0:1788940509.790407:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940509.790506:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718332288 00000100:00100000:3.0:1788940509.790545:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718332288 00000100:00100000:3.0:1788940509.790625:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 40 00000100:00100000:3.0:1788940509.790637:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1baadca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+35:11398:x1875839718332288:12345-192.168.202.14@tcp:35:lfs.0 00000100:00100000:3.0:1788940509.791039:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1baadca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+36:11398:x1875839718332288:12345-192.168.202.14@tcp:35:lfs.0 Request processed in 402us (651us total) trans 4294967435 rc 0/0 00000100:00100000:3.0:1788940509.791050:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 40 00000100:00100000:0.0:1788940509.863851:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940509.868648:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718332544 00000100:00100000:2.0:1788940509.868672:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718332544 00000100:00100000:2.0:1788940509.868919:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 151 00000100:00100000:2.0:1788940509.868932:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b500ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+36:11401:x1875839718332544:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:2.0:1788940509.868964:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940509.868989:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b52f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f59b1 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940509.869089:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4b536 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940509.869313:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4b536 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940509.869328:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4b536 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940509.869347:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4b53d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940509.869355:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4b53d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940509.869361:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4b53d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940509.870418:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940509.872461:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b544 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940509.872504:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b544 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940509.872549:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b544 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940509.872601:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788940509.872975:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4b536 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940509.872985:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4b536 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940509.872993:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4b536 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940509.872999:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188dabe00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940509.873005:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4b536 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940509.873013:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4b536 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940509.873040:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89f1983af600) 00010000:00010000:2.0:1788940509.873044:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940509.873050:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4b536 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940509.873057:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4b536 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940509.873076:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4b53d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940509.873082:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4b53d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940509.873101:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4b53d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940509.873106:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188dab800 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940509.873110:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4b53d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940509.873117:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4b53d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940509.873126:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff89f186946000) 00010000:00010000:2.0:1788940509.873129:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940509.873132:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4b53d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940509.873137:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4b53d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940509.873210:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b52f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f59b1 expref: 39 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940509.873228:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b544 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f59b1 expref: 38 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940509.873236:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89f188f81100) 00010000:00010000:2.0:1788940509.873238:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788940509.873241:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f188daaa00, rc 0) 00000100:00100000:2.0:1788940509.873506:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b500ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+38:11401:x1875839718332544:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 4574us (9668us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1788940509.873573:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 151 00000100:00100000:0.0:1788940509.880828:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940509.881319:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718332672 00000100:00100000:1.0:1788940509.881337:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718332672 00000100:00100000:1.0:1788940509.881426:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 152 00000100:00100000:1.0:1788940509.881438:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b500d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+38:11401:x1875839718332672:12345-192.168.202.14@tcp:54:lfs.0 00010000:00010000:1.0:1788940509.881559:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4b552 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940509.881581:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4b552 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940509.881597:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4b552 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940509.881632:0:7857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4b552 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940509.881640:0:7857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4b552 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940509.881647:0:7857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4b552 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940509.881654:0:7857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258dc00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940509.881659:0:7857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4b552 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940509.881668:0:7857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4b552 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940509.881681:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89f188f81100) 00010000:00010000:1.0:1788940509.881685:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788940509.881691:0:7857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4b552 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940509.881927:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4b552 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940509.882096:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b500d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+38:11401:x1875839718332672:12345-192.168.202.14@tcp:54:lfs.0 Request processed in 657us (4590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940509.882105:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 152 00000100:00100000:1.0:1788940509.889062:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940509.889335:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718332928 00000100:00100000:3.0:1788940509.889350:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718332928 00000100:00100000:3.0:1788940509.889424:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 41 00000100:00100000:3.0:1788940509.889436:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1baadf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+38:11401:x1875839718332928:12345-192.168.202.14@tcp:35:lfs.0 00000100:00100000:3.0:1788940509.890172:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1baadf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+39:11401:x1875839718332928:12345-192.168.202.14@tcp:35:lfs.0 Request processed in 732us (1124us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1788940509.890184:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 41 00000100:00100000:0.0:1788940510.251303:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940510.251748:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718333184 00000100:00100000:3.0:1788940510.251764:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718333184 00000100:00100000:3.0:1788940510.251872:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 153 00000100:00100000:3.0:1788940510.251884:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b500ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+39:11432:x1875839718333184:12345-192.168.202.14@tcp:101:cat.0 00010000:00010000:3.0:1788940510.251923:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940510.251972:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b559 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f59b8 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940510.252145:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b560 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940510.252167:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b560 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940510.252187:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b560 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940510.252214:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788940510.252416:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b559 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f59b8 expref: 42 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940510.252446:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b560 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f59b8 expref: 41 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940510.252456:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89f188f81100) 00010000:00010000:3.0:1788940510.252460:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788940510.252465:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f180030a00, rc 0) 00000100:00100000:3.0:1788940510.252786:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b500ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+41:11432:x1875839718333184:12345-192.168.202.14@tcp:101:cat.0 Request processed in 903us (1505us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1788940510.252795:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 153 00000100:00080000:0.0:1788940510.254403:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788940510.260401:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940510.260871:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718333440 00000100:00100000:1.0:1788940510.260885:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718333440 00000100:00100000:1.0:1788940510.261119:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 42 00000100:00100000:1.0:1788940510.261132:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b500fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+41:11432:x1875839718333440:12345-192.168.202.14@tcp:35:cat.0 00000100:00100000:1.0:1788940510.262670:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b500fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+42:11432:x1875839718333440:12345-192.168.202.14@tcp:35:cat.0 Request processed in 1529us (2273us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1788940510.262685:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 42 00000100:00100000:2.0:1788940510.266984:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940510.267097:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718333568 00000100:00100000:0.0:1788940510.267168:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718333568 00000100:00100000:0.0:1788940510.267752:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 12 00000100:00100000:0.0:1788940510.267767:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bff63100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+42:2352:x1875839718333568:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940510.267790:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940510.267825:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b560 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f59b8 expref: 42 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940510.267851:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89f188f81100) 00010000:00010000:0.0:1788940510.267857:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940510.267969:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bff63100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+41:2352:x1875839718333568:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 207us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940510.267977:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 12 00000100:00100000:0.0:1788940510.336609:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940510.336718:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718333824 00000100:00100000:3.0:1788940510.336733:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718333824 00000100:00100000:3.0:1788940510.336803:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 154 00000100:00100000:3.0:1788940510.336815:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b500e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+41:11438:x1875839718333824:12345-192.168.202.14@tcp:101:dd.0 00010000:00010000:3.0:1788940510.336868:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940510.336872:0:5860:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788940510.336907:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4b4c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f598e expref: 41 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940510.336932:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89f1983af600) 00010000:00010000:3.0:1788940510.336939:0:5860:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788940510.336956:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b56e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f59bf expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940510.337103:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b575 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940510.337121:0:5860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b544 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f59b1 expref: 41 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940510.337130:0:5860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b575 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940510.337175:0:5860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b544 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f59b1 expref: 41 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940510.337191:0:5860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b544 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f59b1 expref: 41 pid: 5862 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940510.337207:0:5860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f191020a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5860:1875839738264832:192.168.202.14@tcp:104: 00000100:00100000:3.0:1788940510.337357:0:5860:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f195ed3b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788940510.340374:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940510.340567:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718333952 00000100:00100000:1.0:1788940510.340578:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718333952 00010000:00010000:1.0:1788940510.340632:0:5845:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b544 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f59b1 expref: 42 pid: 5862 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940510.340680:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 65 00000100:00100000:1.0:1788940510.340693:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f191022d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+42:2353:x1875839718333952:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788940510.340715:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940510.340723:0:5845:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b544 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f59b1 expref: 42 pid: 5862 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940510.340739:0:5845:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b544 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f59b1 expref: 42 pid: 5862 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940510.340781:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89f188f81100) 00010000:00010000:1.0:1788940510.340787:0:5845:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b575 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940510.340799:0:5845:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b575 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940510.340810:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b575 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940510.340836:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940510.340893:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f191022d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+42:2353:x1875839718333952:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 203us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940510.340901:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 65 00010000:00010000:2.0:1788940510.341095:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b544 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f59b1 expref: 41 pid: 5862 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940510.341118:0:5860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f191020a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5860:1875839738264832:192.168.202.14@tcp:104: 00010000:00010000:2.0:1788940510.341147:0:5860:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b575 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940510.341160:0:5860:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b575 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940510.341166:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b575 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940510.341196:0:5860:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788940510.341451:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b56e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f59bf expref: 42 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940510.341474:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b575 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f59bf expref: 41 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940510.341483:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89f188f81100) 00010000:00010000:2.0:1788940510.341486:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788940510.341489:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f180031800, rc 0) 00000100:00100000:2.0:1788940510.341568:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b500e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+41:11438:x1875839718333824:12345-192.168.202.14@tcp:101:dd.0 Request processed in 4755us (4975us total) trans 4294967440 rc 0/0 00000100:00100000:2.0:1788940510.341577:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 154 00000100:00100000:2.0:1788940510.345204:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940510.345373:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718334208 00000100:00100000:3.0:1788940510.345384:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718334208 00000100:00100000:3.0:1788940510.345457:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 155 00000100:00100000:3.0:1788940510.345469:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f184195500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+41:11438:x1875839718334208:12345-192.168.202.14@tcp:36:dd.0 00010000:00010000:3.0:1788940510.345899:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b583 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940510.345925:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b583 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940510.345938:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b583 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788940510.346001:0:5861:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967441 00000004:00010000:3.0:1788940510.346029:0:5861:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000007715457 reply state 000000005d2b7288 transno 4294967442 ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b583 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940510.346040:0:5861:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788940510.346168:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f184195500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+44:11438:x1875839718334208:12345-192.168.202.14@tcp:36:dd.0 Request processed in 698us (979us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1788940510.346177:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 155 00000020:00080000:3.0:1788940510.346182:0:5861:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788940510.349183:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b583 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940510.349210:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b583 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940510.349218:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b583 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940510.349225:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f180030a00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940510.349251:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b583 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940510.349271:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b583 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940510.349292:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89f188f81100) 00010000:00010000:3.0:1788940510.349296:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940510.349302:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b583 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940510.349310:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b583 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940510.614083:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940510.614197:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718334336 00000100:00100000:1.0:1788940510.614210:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718334336 00000100:00100000:1.0:1788940510.614324:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 156 00000100:00100000:1.0:1788940510.614336:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f184194380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+43:11452:x1875839718334336:12345-192.168.202.14@tcp:101:stat.0 00010000:00010000:1.0:1788940510.614371:0:7857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940510.614399:0:7857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4b58a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f59c6 expref: -99 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940510.614508:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4b591 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940510.614563:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4b591 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940510.614578:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4b591 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940510.614615:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4b598 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940510.614623:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4b598 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940510.614631:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4b598 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940510.614766:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b59f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940510.614780:0:7857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b575 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f59bf expref: 44 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940510.614790:0:7857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b59f lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940510.614835:0:7857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b575 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f59bf expref: 44 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940510.614851:0:7857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b575 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f59bf expref: 44 pid: 5860 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940510.614868:0:7857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1baadf800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7857:1875839738264960:192.168.202.14@tcp:104: 00000100:00100000:1.0:1788940510.614990:0:7857:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1862e4000 going to sleep for 11 seconds 00000100:00100000:0.0:1788940510.620113:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940510.620320:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718334592 00000100:00100000:3.0:1788940510.620332:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718334592 00000100:00100000:3.0:1788940510.620402:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 43 00000100:00100000:3.0:1788940510.620413:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b500f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+45:9966:x1875839718334592:12345-192.168.202.14@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788940510.621354:0:7857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1baadf800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7857:1875839738264960:192.168.202.14@tcp:104: 00010000:00010000:1.0:1788940510.621398:0:7857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b59f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940510.621647:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b500f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+46:9966:x1875839718334592:12345-192.168.202.14@tcp:35:ldlm_bl.0 Request processed in 1235us (1550us total) trans 4294967443 rc 0/0 00000100:00100000:3.0:1788940510.621659:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 43 00000100:00100000:0.0:1788940510.625317:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940510.625454:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718334720 00000100:00100000:1.0:1788940510.625467:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718334720 00010000:00010000:1.0:1788940510.625620:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b575 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f59bf expref: 46 pid: 5860 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940510.625705:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 66 00000100:00100000:1.0:1788940510.625718:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1aed95f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+46:2353:x1875839718334720:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788940510.625739:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940510.625748:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b575 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f59bf expref: 46 pid: 5860 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940510.625764:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b575 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f59bf expref: 46 pid: 5860 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940510.625795:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b575 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f59bf expref: 46 pid: 5860 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940510.625818:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89f188f81100) 00010000:00010000:1.0:1788940510.625824:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b59f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940510.625836:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b59f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940510.625846:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b59f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940510.625891:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940510.626004:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1aed95f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+45:2353:x1875839718334720:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 288us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940510.626013:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 66 00010000:00010000:3.0:1788940510.626147:0:7857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b59f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940510.626158:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b59f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940510.626242:0:7857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788940510.626247:0:7857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788940510.626287:0:7857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b59f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940510.626319:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b59f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940510.626334:0:7857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4b591 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940510.626343:0:7857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4b591 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940510.626351:0:7857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4b591 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940510.626357:0:7857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258d800 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940510.626363:0:7857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4b591 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940510.626372:0:7857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4b591 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940510.626381:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89f1983af600) 00010000:00010000:3.0:1788940510.626384:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940510.626388:0:7857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4b591 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940510.626394:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4b591 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940510.626406:0:7857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4b598 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940510.626412:0:7857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4b598 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940510.626427:0:7857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4b598 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940510.626432:0:7857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258d000 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940510.626435:0:7857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4b598 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940510.626441:0:7857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4b598 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940510.626448:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff89f188f81900) 00010000:00010000:3.0:1788940510.626450:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940510.626453:0:7857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4b598 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940510.626458:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4b598 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940510.626513:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4b58a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f59c6 expref: 45 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940510.626568:0:7857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b59f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f59c6 expref: 44 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940510.626577:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89f188f81100) 00010000:00010000:3.0:1788940510.626579:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788940510.626582:0:7857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f19258c400, rc 0) 00000100:00100000:3.0:1788940510.626631:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f184194380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+44:11452:x1875839718334336:12345-192.168.202.14@tcp:101:stat.0 Request processed in 12298us (12576us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940510.626649:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 156 00000100:00100000:2.0:1788940510.690067:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940510.690564:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718334976 00000100:00100000:3.0:1788940510.690580:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718334976 00000100:00100000:3.0:1788940510.690671:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 157 00000100:00100000:3.0:1788940510.690683:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+44:11458:x1875839718334976:12345-192.168.202.14@tcp:36:truncate.0 00010000:00010000:3.0:1788940510.690783:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940510.690825:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b59f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f59c6 expref: 44 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940510.690852:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89f188f81100) 00010000:00010000:3.0:1788940510.690859:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788940510.691224:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b5a6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940510.691244:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b5a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940510.691267:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b5a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788940510.691334:0:5861:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967444 00000004:00010000:3.0:1788940510.691363:0:5861:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e1dc8597 reply state 00000000783e9478 transno 4294967445 ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b5a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940510.691374:0:5861:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788940510.691503:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+46:11458:x1875839718334976:12345-192.168.202.14@tcp:36:truncate.0 Request processed in 820us (1465us total) trans 4294967445 rc 0/0 00000100:00100000:3.0:1788940510.691512:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 157 00000020:00080000:3.0:1788940510.691589:0:5861:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788940510.696483:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b5a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940510.696503:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b5a6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940510.696510:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b5a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940510.696515:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f180030a00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940510.696544:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b5a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940510.696554:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b5a6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940510.696577:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89f188f81100) 00010000:00010000:3.0:1788940510.696581:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940510.696592:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b5a6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940510.696598:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b5a6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788940510.839677:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967428 is committed 00000001:00080000:2.0:1788940510.839715:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967439 is committed 00000004:00080000:2.0:1788940510.839724:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:2.0:1788940510.839748:0:5883:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89f186823c00 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1788940510.839755:0:5883:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89f1bf9c5200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89f186823f00 00000020:00080000:2.0:1788940510.839759:0:5883:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89f1bf9c5500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89f1b48f3800 00000001:00080000:2.0:1788940510.839787:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967440 is committed 00000001:00080000:2.0:1788940510.839817:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967445 is committed 00000020:00080000:2.0:1788940510.840031:0:5894:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1788940510.840278:0:5894:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1788940510.840305:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5835c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738265088:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788940510.840433:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940510.840595:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738265088 00000100:00100000:2.0:1788940510.840605:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738265088 00000100:00100000:2.0:1788940510.840658:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788940510.840668:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1875839738265088:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788940510.840705:0:6705:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:2.0:1788940510.840751:0:6705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa110de, atime: 0x6aa110de, ctime: 0x6aa110de, blocks: 0x1 00010000:00010000:2.0:1788940510.840760:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000205a5504/0x27a633fcdd4b5ad lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940510.840781:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=453s v=(0 0) 00010000:00010000:2.0:1788940510.840786:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940510.840794:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000205a5504/0x27a633fcdd4b5ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940510.840825:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000205a5504/0x27a633fcdd4b5ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940510.840836:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000205a5504/0x27a633fcdd4b5ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940510.840844:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000205a5504/0x27a633fcdd4b5ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940510.840865:0:6705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788940510.841454:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3305:x1875839738265088:12345-0@lo:6:osp-syn-1-0.0 Request processed in 785us (1019us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788940510.841466:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:2.0:1788940510.841512:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940510.841558:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000205a5504/0x27a633fcdd4b5ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940510.841569:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188dabe00 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:2.0:1788940510.841574:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000205a5504/0x27a633fcdd4b5ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940510.841586:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000205a5504/0x27a633fcdd4b5ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940510.841611:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000205a5504/0x27a633fcdd4b5ad lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940510.841629:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000205a5504/0x27a633fcdd4b5ad lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940510.841655:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940510.841657:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940510.841660:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788940510.841699:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89f1b5835c00/2, rc 0, transno 4294967307 00000100:00100000:2.0:1788940510.841706:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5835c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738265088:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788940510.877868:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940510.877997:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718335104 00000100:00100000:0.0:1788940510.878010:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718335104 00000100:00100000:0.0:1788940510.878092:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 158 00000100:00100000:0.0:1788940510.878104:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+15:11472:x1875839718335104:12345-192.168.202.14@tcp:101:stat.0 00010000:00010000:0.0:1788940510.878139:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940510.878171:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4b5b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f59cd expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940510.878284:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b5bb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940510.878309:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b5bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940510.878324:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b5bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940510.878344:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b5c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940510.878351:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b5c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940510.878358:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b5c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940510.878938:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b5c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940510.878962:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b5c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940510.878971:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b5c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940510.879022:0:5860:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1788940510.879028:0:5860:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788940510.879060:0:5860:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b5c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940510.879073:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b5c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940510.879083:0:5860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b5bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940510.879090:0:5860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b5bb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940510.879096:0:5860:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b5bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940510.879103:0:5860:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad2000 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:0.0:1788940510.879108:0:5860:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b5bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940510.879116:0:5860:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b5bb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940510.879130:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89f1983af600) 00010000:00010000:0.0:1788940510.879133:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940510.879147:0:5860:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b5bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940510.879153:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b5bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940510.879168:0:5860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b5c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940510.879174:0:5860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b5c2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940510.879179:0:5860:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b5c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940510.879184:0:5860:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad3800 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:0.0:1788940510.879187:0:5860:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b5c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940510.879194:0:5860:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b5c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940510.879203:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff89f1983afa00) 00010000:00010000:0.0:1788940510.879206:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940510.879208:0:5860:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b5c2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940510.879226:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b5c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940510.879281:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4b5b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f59cd expref: 17 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940510.879312:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b5c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f59cd expref: 16 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940510.879320:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89f188f81100) 00010000:00010000:0.0:1788940510.879323:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788940510.879326:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f082ad2800, rc 0) 00000100:00100000:0.0:1788940510.879635:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+16:11472:x1875839718335104:12345-192.168.202.14@tcp:101:stat.0 Request processed in 1532us (1784us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940510.879646:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 158 00010000:00010000:0.0:1788940510.892775:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940510.970332:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940510.970442:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718335360 00000100:00100000:3.0:1788940510.970454:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718335360 00000100:00100000:2.0:1788940510.970908:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 159 00000100:00100000:2.0:1788940510.970923:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+16:11482:x1875839718335360:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:2.0:1788940510.970952:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940510.970981:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4b5d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f59d4 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940510.971123:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788940510.971443:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4b5d0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f59d4 expref: 18 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940510.971461:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f186946e00) 00010000:00010000:2.0:1788940510.971465:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788940510.971471:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4b5d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f59d4 expref: 18 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940510.971555:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f188dabe00, rc 0) 00000100:00100000:3.0:1788940510.975193:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940510.975514:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718335616 00000100:00100000:1.0:1788940510.975576:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718335616 00000100:00100000:1.0:1788940510.975646:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 44 00000100:00100000:1.0:1788940510.975671:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b0612050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+18:11482:x1875839718335616:12345-192.168.202.14@tcp:35:lfs.0 00000100:00100000:1.0:1788940510.976974:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b0612050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+19:11482:x1875839718335616:12345-192.168.202.14@tcp:35:lfs.0 Request processed in 1309us (1789us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1788940510.976988:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 44 00000100:00100000:2.0:1788940510.977128:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+18:11482:x1875839718335360:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 737us (1341us total) trans 4294967446 rc 301/301 00000100:00100000:2.0:1788940510.977138:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 159 00000100:00100000:1.0:1788940511.046408:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940511.046563:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718335872 00000100:00100000:3.0:1788940511.046575:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718335872 00000100:00100000:3.0:1788940511.046641:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 160 00000100:00100000:3.0:1788940511.046652:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1baadca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+18:11488:x1875839718335872:12345-192.168.202.14@tcp:101:bash.0 00010000:00010000:3.0:1788940511.046685:0:7857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940511.046740:0:7857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b5de lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f59db expref: -99 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940511.046878:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b5e5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940511.046897:0:7857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b5c9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f59cd expref: 19 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940511.046908:0:7857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b5e5 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940511.046953:0:7857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b5c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f59cd expref: 19 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940511.046968:0:7857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b5c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f59cd expref: 19 pid: 5860 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940511.046985:0:7857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f191020700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7857:1875839738265216:192.168.202.14@tcp:104: 00000100:00100000:3.0:1788940511.047118:0:7857:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f195ed3b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788940511.050567:0:7857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f191020700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7857:1875839738265216:192.168.202.14@tcp:104: 00010000:00010000:3.0:1788940511.050608:0:7857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b5e5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940511.052550:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940511.052708:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718336000 00000100:00100000:0.0:1788940511.052721:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718336000 00010000:00010000:0.0:1788940511.052778:0:5845:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b5c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f59cd expref: 20 pid: 5860 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940511.052827:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 67 00000100:00100000:0.0:1788940511.052839:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1baadf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+20:2353:x1875839718336000:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940511.052857:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940511.052865:0:5845:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b5c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f59cd expref: 20 pid: 5860 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940511.052881:0:5845:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b5c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f59cd expref: 20 pid: 5860 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940511.052908:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b5c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f59cd expref: 20 pid: 5860 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940511.052953:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89f188f81100) 00010000:00010000:0.0:1788940511.052959:0:5845:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b5e5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940511.052971:0:5845:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b5e5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940511.052981:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b5e5 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940511.053030:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940511.053111:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1baadf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+19:2353:x1875839718336000:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 273us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940511.053119:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 67 00010000:00010000:1.0:1788940511.053374:0:7857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b5e5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940511.053384:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b5e5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940511.053410:0:7857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1788940511.054302:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b5de lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f59db expref: 20 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940511.054334:0:7857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b5e5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f59db expref: 19 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940511.054344:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89f188f81100) 00010000:00010000:1.0:1788940511.054347:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788940511.054351:0:7857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f180031600, rc 0) 00000100:00100000:1.0:1788940511.054430:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1baadca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+19:11488:x1875839718335872:12345-192.168.202.14@tcp:101:bash.0 Request processed in 7779us (8038us total) trans 4294967448 rc 0/0 00000100:00100000:1.0:1788940511.054440:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 160 00000100:00100000:0.0:1788940511.057156:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940511.057244:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718336256 00000100:00100000:3.0:1788940511.057266:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718336256 00000100:00100000:3.0:1788940511.057340:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 161 00000100:00100000:3.0:1788940511.057353:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1aed95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+19:11488:x1875839718336256:12345-192.168.202.14@tcp:36:bash.0 00010000:00010000:3.0:1788940511.059151:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b5f3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940511.059203:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b5f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940511.059219:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b5f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788940511.059331:0:5861:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967449 00000004:00010000:3.0:1788940511.059376:0:5861:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cc3d5ca6 reply state 00000000a8ea8dc7 transno 4294967450 ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b5f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940511.059386:0:5861:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788940511.059586:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1aed95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+22:11488:x1875839718336256:12345-192.168.202.14@tcp:36:bash.0 Request processed in 2229us (2438us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1788940511.059596:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 161 00000020:00080000:3.0:1788940511.059603:0:5861:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788940511.065848:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b5f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940511.065873:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b5f3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940511.065882:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b5f3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940511.065890:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f180030000 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940511.065897:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b5f3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940511.065907:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b5f3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940511.065951:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89f188f81100) 00010000:00010000:3.0:1788940511.065954:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940511.065961:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b5f3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940511.065968:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b5f3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940511.066143:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940511.066458:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718336384 00000100:00100000:0.0:1788940511.066473:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718336384 00000100:00100000:0.0:1788940511.067095:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 162 00000100:00100000:0.0:1788940511.067110:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+21:11488:x1875839718336384:12345-192.168.202.14@tcp:101:bash.0 00010000:00010000:0.0:1788940511.067146:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940511.067172:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b5fa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f59e2 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940511.069604:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b601 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940511.069643:0:5860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b5e5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f59db expref: 22 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940511.069691:0:5860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b601 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940511.069869:0:5860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b5e5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f59db expref: 22 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940511.069891:0:5860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b5e5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f59db expref: 22 pid: 7857 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940511.069909:0:5860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1aed94a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5860:1875839738265344:192.168.202.14@tcp:104: 00000100:00100000:0.0:1788940511.070380:0:5860:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f18403d300 going to sleep for 11 seconds 00000100:00100000:1.0:1788940511.075358:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940511.075648:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718336512 00000100:00100000:2.0:1788940511.075670:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718336512 00010000:00010000:2.0:1788940511.075736:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b5e5 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f59db expref: 23 pid: 7857 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940511.075783:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 68 00000100:00100000:2.0:1788940511.075795:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1baadf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+23:2352:x1875839718336512:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788940511.075812:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940511.075821:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b5e5 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f59db expref: 23 pid: 7857 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940511.075835:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b5e5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f59db expref: 23 pid: 7857 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940511.075861:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89f188f81100) 00010000:00010000:2.0:1788940511.075867:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b601 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940511.075879:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b601 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940511.075888:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b601 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940511.075933:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940511.076284:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1baadf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+23:2352:x1875839718336512:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 490us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940511.076294:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 68 00010000:00010000:0.0:1788940511.076435:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b5e5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f59db expref: 22 pid: 7857 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940511.076459:0:5860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1aed94a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5860:1875839738265344:192.168.202.14@tcp:104: 00010000:00010000:0.0:1788940511.076499:0:5860:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b601 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940511.076510:0:5860:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b601 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940511.076593:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b601 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940511.076668:0:5860:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788940511.076674:0:5860:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788940511.076907:0:5860:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b601 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940511.076966:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b5fa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f59e2 expref: 22 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940511.076985:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b601 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f59e2 expref: 21 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940511.076994:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89f188f81100) 00010000:00010000:0.0:1788940511.076998:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788940511.077001:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f082ad3800, rc 0) 00000100:00100000:0.0:1788940511.077062:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+21:11488:x1875839718336384:12345-192.168.202.14@tcp:101:bash.0 Request processed in 9955us (11358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940511.077071:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 162 00000100:00100000:0.0:1788940511.080624:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940511.080863:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718336768 00000100:00100000:3.0:1788940511.080876:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718336768 00000100:00100000:3.0:1788940511.080945:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 45 00000100:00100000:3.0:1788940511.080958:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1aed94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+21:11488:x1875839718336768:12345-192.168.202.14@tcp:35:bash.0 00000100:00100000:3.0:1788940511.081339:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1aed94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+22:11488:x1875839718336768:12345-192.168.202.14@tcp:35:bash.0 Request processed in 382us (729us total) trans 4294967451 rc 0/0 00000100:00100000:3.0:1788940511.081348:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 45 00000100:00100000:3.0:1788940511.166241:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940511.166387:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718337024 00000100:00100000:2.0:1788940511.166401:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718337024 00000100:00100000:2.0:1788940511.166484:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 163 00000100:00100000:2.0:1788940511.166496:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f191020700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+22:11498:x1875839718337024:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:2.0:1788940511.166582:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940511.166615:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4b608 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f59e9 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940511.166824:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788940511.167023:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4b608 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f59e9 expref: 24 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940511.167043:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f186946e00) 00010000:00010000:2.0:1788940511.167046:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788940511.167053:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4b608 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f59e9 expref: 24 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940511.167069:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f188dab600, rc 0) 00000100:00100000:2.0:1788940511.167143:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f191020700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+23:11498:x1875839718337024:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 649us (919us total) trans 4294967452 rc 301/301 00000100:00100000:2.0:1788940511.167151:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 163 00000100:00100000:0.0:1788940511.170399:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940511.170625:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718337152 00000100:00100000:1.0:1788940511.170638:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718337152 00000100:00100000:1.0:1788940511.170723:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 164 00000100:00100000:1.0:1788940511.170736:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1aed97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+23:11498:x1875839718337152:12345-192.168.202.14@tcp:34:lfs.0 00010000:00010000:1.0:1788940511.170851:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4b616 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940511.170891:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4b616 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940511.170910:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4b616 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940511.170927:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b61d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940511.170933:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b61d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940511.170939:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b61d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940511.171384:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4b624 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940511.171397:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4b624 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940511.171420:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4b624 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788940511.171488:0:7857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4b624 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940511.171503:0:7857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4b616 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940511.171510:0:7857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4b616 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940511.171571:0:7857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4b616 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940511.171579:0:7857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258c600 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940511.171585:0:7857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4b616 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940511.171595:0:7857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4b616 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940511.171610:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89f1983af600) 00010000:00010000:1.0:1788940511.171613:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940511.171621:0:7857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4b616 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940511.171629:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4b616 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940511.171643:0:7857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b61d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940511.171656:0:7857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b61d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940511.171663:0:7857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b61d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940511.171667:0:7857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258c400 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940511.171671:0:7857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b61d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940511.171677:0:7857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b61d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940511.171686:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff89f188f81000) 00010000:00010000:1.0:1788940511.171688:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940511.171692:0:7857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b61d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940511.171699:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b61d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940511.171716:0:7857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4b624 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940511.171722:0:7857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4b624 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940511.171727:0:7857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4b624 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940511.171732:0:7857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258d400 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940511.171742:0:7857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4b624 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940511.171749:0:7857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4b624 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940511.171757:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89f188f81100) 00010000:00010000:1.0:1788940511.171760:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940511.171763:0:7857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4b624 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940511.171769:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4b624 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940511.171874:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1aed97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+23:11498:x1875839718337152:12345-192.168.202.14@tcp:34:lfs.0 Request processed in 1138us (1491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940511.171885:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 164 00000100:00100000:0.0:1788940511.175384:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940511.175485:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718337408 00000100:00100000:3.0:1788940511.175499:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718337408 00000100:00100000:3.0:1788940511.175595:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 46 00000100:00100000:3.0:1788940511.175606:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1aed96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+23:11498:x1875839718337408:12345-192.168.202.14@tcp:35:lfs.0 00000100:00100000:3.0:1788940511.175991:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1aed96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+24:11498:x1875839718337408:12345-192.168.202.14@tcp:35:lfs.0 Request processed in 385us (622us total) trans 4294967453 rc 0/0 00000100:00100000:3.0:1788940511.175999:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 46 00000100:00100000:3.0:1788940511.210257:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940511.210443:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718337664 00000100:00100000:2.0:1788940511.210479:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718337664 00000100:00100000:2.0:1788940511.210610:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 165 00000100:00100000:2.0:1788940511.210622:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f191020a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+24:11501:x1875839718337664:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:2.0:1788940511.210658:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940511.210688:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4b62b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f59f0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940511.210905:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4b632 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940511.210924:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4b632 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940511.210939:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4b632 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940511.210954:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4b639 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940511.210961:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4b639 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940511.210966:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4b639 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940511.211412:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b640 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940511.211425:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b640 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940511.211433:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b640 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940511.211454:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788940511.211614:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4b632 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940511.211624:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4b632 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940511.211631:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4b632 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940511.211639:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188dabe00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940511.211644:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4b632 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940511.211653:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4b632 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940511.211668:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89f1983af600) 00010000:00010000:2.0:1788940511.211671:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940511.211679:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4b632 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940511.211686:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4b632 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940511.211897:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4b639 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940511.211905:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4b639 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940511.211911:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4b639 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940511.211924:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188dab800 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940511.211926:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4b639 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940511.211932:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4b639 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940511.211941:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff89f186946000) 00010000:00010000:2.0:1788940511.211943:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940511.211946:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4b639 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940511.211952:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4b639 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940511.212081:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4b62b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f59f0 expref: 27 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940511.212099:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b640 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f59f0 expref: 26 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940511.212108:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89f188f81100) 00010000:00010000:2.0:1788940511.212110:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788940511.212113:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f188daaa00, rc 0) 00000100:00100000:2.0:1788940511.212262:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f191020a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+26:11501:x1875839718337664:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 1642us (2031us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1788940511.212273:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 165 00000100:00100000:0.0:1788940511.217218:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940511.218961:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718337792 00000100:00100000:1.0:1788940511.218979:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718337792 00000100:00100000:1.0:1788940511.219080:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 166 00000100:00100000:1.0:1788940511.219092:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1aed96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+26:11501:x1875839718337792:12345-192.168.202.14@tcp:54:lfs.0 00010000:00010000:1.0:1788940511.219185:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4b64e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940511.219208:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4b64e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940511.219222:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4b64e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940511.219265:0:7857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4b64e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940511.219289:0:7857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4b64e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940511.219298:0:7857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4b64e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940511.219305:0:7857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258d400 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940511.219310:0:7857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4b64e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940511.219320:0:7857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4b64e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940511.219334:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89f188f81100) 00010000:00010000:1.0:1788940511.219337:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788940511.219344:0:7857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4b64e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940511.219351:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d400/0x27a633fcdd4b64e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940511.222084:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1aed96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+26:11501:x1875839718337792:12345-192.168.202.14@tcp:54:lfs.0 Request processed in 2976us (4863us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940511.222103:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 166 00000100:00100000:3.0:1788940511.224313:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940511.225085:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718337920 00000100:00100000:0.0:1788940511.225101:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718337920 00000100:00100000:0.0:1788940511.225243:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 13 00000100:00100000:0.0:1788940511.225265:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f191023480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+26:2352:x1875839718337920:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940511.225287:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940511.225321:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b640 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f59f0 expref: 26 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940511.225351:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89f188f81100) 00010000:00010000:0.0:1788940511.225358:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940511.225464:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f191023480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+25:2352:x1875839718337920:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 201us (1162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940511.225472:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 13 00000100:00100000:2.0:1788940511.228313:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940511.228439:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718338176 00000100:00100000:3.0:1788940511.228458:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718338176 00000100:00100000:3.0:1788940511.228689:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 47 00000100:00100000:3.0:1788940511.228774:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+25:11501:x1875839718338176:12345-192.168.202.14@tcp:35:lfs.0 00000100:00100000:3.0:1788940511.229198:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+26:11501:x1875839718338176:12345-192.168.202.14@tcp:35:lfs.0 Request processed in 497us (898us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1788940511.229206:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 47 00000100:00100000:1.0:1788940511.371324:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940511.371421:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718338432 00000100:00100000:3.0:1788940511.371432:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718338432 00000100:00100000:3.0:1788940511.371492:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 167 00000100:00100000:3.0:1788940511.371505:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1baadfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+26:11519:x1875839718338432:12345-192.168.202.14@tcp:101:cat.0 00010000:00010000:3.0:1788940511.371587:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940511.371612:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b655 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f59f7 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940511.371844:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b65c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940511.371861:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b65c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940511.371871:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b65c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940511.371882:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788940511.372041:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b655 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f59f7 expref: 29 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940511.372066:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b65c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f59f7 expref: 28 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940511.372094:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89f188f81100) 00010000:00010000:3.0:1788940511.372096:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788940511.372099:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f180031600, rc 0) 00000100:00100000:3.0:1788940511.372216:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1baadfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+28:11519:x1875839718338432:12345-192.168.202.14@tcp:101:cat.0 Request processed in 713us (909us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1788940511.372224:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 167 00000100:00100000:2.0:1788940511.399794:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940511.400117:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718338560 00000100:00100000:0.0:1788940511.400131:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718338560 00000100:00100000:0.0:1788940511.400207:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 168 00000100:00100000:0.0:1788940511.400218:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+28:11520:x1875839718338560:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:0.0:1788940511.400284:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940511.400312:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4b66a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f59fe expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940511.400402:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b671 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940511.400421:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b671 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940511.400436:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b671 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940511.400623:0:5860:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788940511.400627:0:5860:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788940511.400654:0:5860:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b671 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940511.400686:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4b66a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f59fe expref: 30 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940511.400843:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b671 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f59fe expref: 29 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940511.400877:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89f1983af600) 00010000:00010000:0.0:1788940511.400880:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788940511.400885:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f082ad2600, rc 0) 00000100:00100000:0.0:1788940511.400966:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+29:11520:x1875839718338560:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 749us (1186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940511.400973:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 168 00000100:00100000:0.0:1788940511.411364:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940511.411943:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718338944 00000100:00100000:1.0:1788940511.411956:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718338944 00000100:00100000:1.0:1788940511.412033:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 48 00000100:00100000:1.0:1788940511.412043:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf97dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+29:11520:x1875839718338944:12345-192.168.202.14@tcp:35:lfs.0 00000100:00100000:1.0:1788940511.412621:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf97dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+30:11520:x1875839718338944:12345-192.168.202.14@tcp:35:lfs.0 Request processed in 576us (1271us total) trans 4294967457 rc 0/0 00000100:00100000:1.0:1788940511.412631:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 48 00000100:00100000:1.0:1788940511.417194:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940511.417324:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718339072 00000100:00100000:2.0:1788940511.417337:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718339072 00000100:00100000:2.0:1788940511.417422:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 14 00000100:00100000:2.0:1788940511.417435:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1841b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+30:11520:x1875839718339072:12345-192.168.202.14@tcp:103:lfs.0 00010000:00010000:2.0:1788940511.417453:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788940511.417486:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b601 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f59e2 expref: 30 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940511.417514:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b65c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f59f7 expref: 29 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940511.417590:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4b505 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f59a3 expref: 28 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940511.417601:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89f188f81100) 00010000:00010000:2.0:1788940511.417615:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940511.417691:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1841b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+27:11520:x1875839718339072:12345-192.168.202.14@tcp:103:lfs.0 Request processed in 258us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940511.418292:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 14 00000100:00100000:2.0:1788940511.421864:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940511.422049:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718339200 00000100:00100000:3.0:1788940511.422063:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718339200 00000100:00100000:3.0:1788940511.422132:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 169 00000100:00100000:3.0:1788940511.422144:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+27:11520:x1875839718339200:12345-192.168.202.14@tcp:58:lfs.0 00010000:00010000:3.0:1788940511.422311:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b678 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940511.422333:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b678 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940511.422347:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b678 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788940511.423027:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1788940511.423162:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+27:11520:x1875839718339200:12345-192.168.202.14@tcp:58:lfs.0 Request processed in 1017us (1311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940511.423173:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 169 00000100:00100000:1.0:1788940511.450661:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940511.450862:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718339328 00000100:00100000:3.0:1788940511.450875:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718339328 00000100:00100000:3.0:1788940511.450945:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 170 00000100:00100000:3.0:1788940511.450957:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1baaded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+27:11522:x1875839718339328:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:3.0:1788940511.451002:0:7857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940511.451038:0:7857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b67f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5a05 expref: -99 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940511.451150:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b686 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940511.451170:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b686 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940511.451185:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b686 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940511.451203:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b68d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940511.451210:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b68d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940511.451216:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b68d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940511.451637:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b694 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940511.451648:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b694 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940511.451656:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b694 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940511.452114:0:7857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788940511.452128:0:7857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788940511.452160:0:7857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b694 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940511.452177:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b694 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940511.452187:0:7857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b686 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940511.452193:0:7857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b686 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940511.452201:0:7857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b686 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940511.452207:0:7857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f180031800 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940511.452212:0:7857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b686 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940511.452222:0:7857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b686 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940511.452235:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89f1983af600) 00010000:00010000:3.0:1788940511.452238:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940511.452253:0:7857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b686 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940511.452261:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b686 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940511.452278:0:7857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b68d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940511.452296:0:7857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b68d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940511.452302:0:7857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b68d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940511.452307:0:7857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f180030400 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940511.452310:0:7857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b68d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940511.452316:0:7857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b68d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940511.452325:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff89f18a6ceb00) 00010000:00010000:3.0:1788940511.452328:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940511.452331:0:7857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b68d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940511.452337:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b68d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940511.452391:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b67f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a05 expref: 29 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940511.452409:0:7857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b694 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a05 expref: 28 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940511.452416:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89f18a6ce700) 00010000:00010000:3.0:1788940511.452419:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788940511.452428:0:7857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f180031600, rc 0) 00000100:00100000:3.0:1788940511.452962:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1baaded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+28:11522:x1875839718339328:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 2003us (2311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940511.452974:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 170 00000040:00080000:2.0:1788940511.916999:0:11708:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788940511.917014:0:11708:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788940511.917345:0:11708:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788940511.917353:0:11708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788940511.917572:0:11708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bfbf3100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11708:1875839738265472:192.168.202.14@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788940511.917725:0:11708:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1b0c923c0 going to sleep for 11 seconds 00010000:00010000:3.0:1788940511.918269:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940511.920806:0:11708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bfbf3100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11708:1875839738265472:192.168.202.14@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788940511.926767:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940511.927052:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718339456 00000100:00100000:3.0:1788940511.927066:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718339456 00000100:00100000:3.0:1788940511.927140:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 171 00000100:00100000:3.0:1788940511.927152:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+28:11533:x1875839718339456:12345-192.168.202.14@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788940511.927205:0:5861:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788940511.927366:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+28:11533:x1875839718339456:12345-192.168.202.14@tcp:53:lhsmtool_posix.0 Request processed in 215us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940511.927376:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 171 00000100:00100000:0.0:1788940511.941690:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940511.941878:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718339584 00000100:00100000:2.0:1788940511.941893:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718339584 00000100:00100000:2.0:1788940511.941980:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 172 00000100:00100000:2.0:1788940511.941993:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf97ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+28:11533:x1875839718339584:12345-192.168.202.14@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788940511.942130:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b69b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940511.942158:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b69b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940511.942175:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b69b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940511.942194:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4b6a2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940511.942202:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4b6a2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940511.942208:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4b6a2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940511.942265:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4b6a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940511.942274:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4b6a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940511.942280:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4b6a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940511.942363:0:5860:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788940511.942369:0:5860:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788940511.942391:0:5860:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4b6a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940511.942406:0:5860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b69b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940511.942413:0:5860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b69b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940511.942422:0:5860:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b69b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940511.942429:0:5860:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188daa600 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940511.942435:0:5860:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b69b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940511.942445:0:5860:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b69b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940511.942462:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89f186946200) 00010000:00010000:2.0:1788940511.942466:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940511.942473:0:5860:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b69b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940511.942481:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b69b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940511.942498:0:5860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4b6a2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940511.942543:0:5860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4b6a2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940511.942551:0:5860:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4b6a2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940511.942556:0:5860:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188dab400 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940511.942560:0:5860:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4b6a2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940511.942567:0:5860:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4b6a2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940511.943206:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff89f186946000) 00010000:00010000:2.0:1788940511.943212:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940511.943216:0:5860:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4b6a2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940511.943225:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4b6a2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940511.943266:0:5860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4b6a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940511.943272:0:5860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4b6a9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940511.943278:0:5860:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4b6a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940511.943284:0:5860:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188daa400 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940511.943298:0:5860:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4b6a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940511.943305:0:5860:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4b6a9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940511.943314:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89f18a6ce700) 00010000:00010000:2.0:1788940511.943316:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940511.943320:0:5860:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4b6a9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940511.943326:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4b6a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940511.943460:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf97ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+28:11533:x1875839718339584:12345-192.168.202.14@tcp:34:lhsmtool_posix.0 Request processed in 1466us (1783us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940511.943472:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 172 00000100:00100000:2.0:1788940511.946434:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940511.946789:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718339840 00000100:00100000:3.0:1788940511.946802:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718339840 00000100:00100000:3.0:1788940511.946891:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 173 00000100:00100000:3.0:1788940511.946904:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+28:11533:x1875839718339840:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788940511.946930:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940511.946956:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b6b0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5a0c expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940511.947091:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b6b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940511.947110:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b6b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940511.947123:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b6b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940511.947150:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788940511.947308:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b6b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940511.947317:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b6b7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940511.947324:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b6b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940511.947331:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f180030400 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940511.947336:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b6b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940511.947344:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b6b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940511.947359:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89f18a6ce700) 00010000:00010000:3.0:1788940511.947363:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788940511.947370:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b6b7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940511.947377:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b6b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940511.947438:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b6b0 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a0c expref: 30 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940511.947450:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89f186946200) 00010000:00010000:3.0:1788940511.947452:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788940511.947462:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b6b0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a0c expref: 30 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940511.947474:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f180030a00, rc 0) 00000100:00100000:3.0:1788940511.983009:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+29:11533:x1875839718339840:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 36081us (36566us total) trans 4294967458 rc 301/301 00000100:00100000:3.0:1788940511.983029:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 173 00000100:00100000:0.0:1788940511.992425:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940511.996643:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718339968 00000100:00100000:3.0:1788940511.996667:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718339968 00000100:00100000:1.0:1788940512.004188:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 174 00000100:00100000:1.0:1788940512.004236:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf97c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+29:11533:x1875839718339968:12345-192.168.202.14@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788940512.004302:0:7857:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788940512.004467:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf97c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+29:11533:x1875839718339968:12345-192.168.202.14@tcp:53:lhsmtool_posix.0 Request processed in 261us (12053us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940512.004476:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 174 00000100:00080000:1.0:1788940512.004587:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788940512.011978:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940512.012096:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718340224 00000100:00100000:1.0:1788940512.012110:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718340224 00000100:00100000:1.0:1788940512.012188:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 175 00000100:00100000:1.0:1788940512.012202:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf97c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+29:11533:x1875839718340224:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788940512.012237:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940512.012250:0:5862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788940512.012291:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b671 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f59fe expref: 29 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940512.012317:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89f1983af600) 00010000:00010000:1.0:1788940512.012324:0:5862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788940512.012344:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4b6c5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5a13 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788940512.013375:0:5862:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:1.0:1788940512.013765:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4b6cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940512.013785:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4b6cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940512.013799:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4b6cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940512.013880:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4b6c5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a13 expref: 31 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940512.013901:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4b6cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a13 expref: 30 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940512.013911:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff89f188f81000) 00010000:00010000:1.0:1788940512.013915:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788940512.013919:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f19258dc00, rc 0) 00000100:00100000:1.0:1788940512.014005:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf97c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+30:11533:x1875839718340224:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 1806us (2045us total) trans 4294967459 rc 0/0 00000100:00100000:1.0:1788940512.014014:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 175 00000100:00100000:3.0:1788940512.033717:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940512.034083:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718340480 00000100:00100000:0.0:1788940512.034099:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718340480 00000100:00100000:0.0:1788940512.034193:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 176 00000100:00100000:0.0:1788940512.034205:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f191022d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+30:11533:x1875839718340480:12345-192.168.202.14@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788940512.034346:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940512.034386:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4b6cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a13 expref: 30 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940512.034408:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff89f188f81000) 00010000:00010000:0.0:1788940512.034422:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788940512.034457:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3400/0x27a633fcdd4b6da lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940512.034474:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3400/0x27a633fcdd4b6da lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940512.034487:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3400/0x27a633fcdd4b6da lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940512.034552:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b6e1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xc5d05f77 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940512.034561:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b6e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xc5d05f77 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940512.034568:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b6e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xc5d05f77 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940512.034873:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3400/0x27a633fcdd4b6da lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940512.034883:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3400/0x27a633fcdd4b6da lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940512.034891:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3400/0x27a633fcdd4b6da lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940512.034898:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad3400 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:0.0:1788940512.034903:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3400/0x27a633fcdd4b6da lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940512.034914:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3400/0x27a633fcdd4b6da lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940512.034924:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89f1983af600) 00010000:00010000:0.0:1788940512.034927:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940512.034932:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3400/0x27a633fcdd4b6da lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940512.034940:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3400/0x27a633fcdd4b6da lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940512.034959:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b6e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xc5d05f77 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940512.034965:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b6e1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc5d05f77 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940512.034972:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b6e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc5d05f77 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940512.034977:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad2800 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:0.0:1788940512.034981:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b6e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc5d05f77 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940512.034989:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b6e1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc5d05f77 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940512.034996:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xc5d05f77 (ffff89f1983afa00) 00010000:00010000:0.0:1788940512.034999:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940512.035002:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b6e1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xc5d05f77 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940512.035008:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b6e1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xc5d05f77 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940512.035125:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f191022d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+29:11533:x1875839718340480:12345-192.168.202.14@tcp:36:lhsmtool_posix.0 Request processed in 919us (1430us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788940512.035135:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 176 00000100:00100000:0.0:1788940512.043235:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940512.043407:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718340608 00000100:00100000:3.0:1788940512.043421:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718340608 00000100:00100000:3.0:1788940512.043498:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 177 00000100:00100000:3.0:1788940512.043510:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf97df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+29:11533:x1875839718340608:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788940512.043564:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940512.043598:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b6e8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5a1a expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.043649:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b6ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.043666:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b6ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.043680:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b6ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.043813:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b6e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a1a expref: 31 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.043850:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b6ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a1a expref: 30 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.043859:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff89f18a6ceb00) 00010000:00010000:3.0:1788940512.043863:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788940512.043867:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f180030400, rc 0) 00000100:00100000:3.0:1788940512.043938:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf97df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+30:11533:x1875839718340608:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 430us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940512.043947:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 177 00000100:00100000:3.0:1788940512.048453:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940512.048664:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718340864 00000100:00100000:0.0:1788940512.048678:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718340864 00000100:00100000:0.0:1788940512.048765:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 178 00000100:00100000:0.0:1788940512.048776:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f191023480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+30:11533:x1875839718340864:12345-192.168.202.14@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788940512.048906:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b6f6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940512.048927:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b6f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940512.048943:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b6f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788940512.049340:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:0.0:1788940512.049356:0:5861:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 454947836637ns, next at 455947833243ns, rc = 0 00000004:00010000:0.0:1788940512.049479:0:5861:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dc1ddcdd reply state 000000008bc1128b transno 4294967460 ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b6f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940512.049490:0:5861:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788940512.049654:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f191023480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+32:11533:x1875839718340864:12345-192.168.202.14@tcp:36:lhsmtool_posix.0 Request processed in 877us (1255us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1788940512.049663:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 178 00000100:00100000:3.0:1788940512.061297:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940512.061343:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718340992 00000100:00100000:3.0:1788940512.061403:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718340992 00000100:00100000:3.0:1788940512.061473:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 179 00000100:00100000:3.0:1788940512.061486:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae81c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+32:11533:x1875839718340992:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788940512.061544:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940512.061574:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b6fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5a21 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.061676:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b6fd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a21 expref: 33 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.061696:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b6fd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a21 expref: 33 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.061723:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff89f18a6ceb00) 00010000:00010000:3.0:1788940512.061741:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788940512.061746:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f180030a00, rc 0) 00000100:00100000:3.0:1788940512.061828:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae81c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+33:11533:x1875839718340992:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 345us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940512.061837:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 179 00010000:00010000:1.0:1788940512.062551:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b6f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940512.062564:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b6f6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940512.062589:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b6f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940512.062597:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad2600 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940512.062602:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b6f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940512.062612:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b6f6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940512.062629:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff89f18a6ceb00) 00010000:00010000:1.0:1788940512.062632:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788940512.062637:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b6f6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940512.062645:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b6f6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940512.066671:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940512.066780:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718341120 00000100:00100000:1.0:1788940512.066794:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718341120 00000100:00100000:1.0:1788940512.066893:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 51 00000100:00100000:1.0:1788940512.066906:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2350:x1875839718341120:12345-192.168.202.14@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1788940512.067717:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788940512.068186:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+7:2350:x1875839718341120:12345-192.168.202.14@tcp:2:lhsmtool_posix.0 Request processed in 1277us (1525us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1788940512.068199:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 51 00000100:00100000:3.0:1788940512.076384:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940512.076474:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718341376 00000100:00100000:0.0:1788940512.076487:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718341376 00000100:00100000:0.0:1788940512.076580:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 49 00000100:00100000:0.0:1788940512.076592:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae81ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+32:11533:x1875839718341376:12345-192.168.202.14@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788940512.076908:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae81ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+33:11533:x1875839718341376:12345-192.168.202.14@tcp:35:lhsmtool_posix.0 Request processed in 317us (538us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1788940512.076916:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 49 00000100:00100000:2.0:1788940512.086209:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940512.086465:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718341632 00000100:00100000:3.0:1788940512.086480:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718341632 00000100:00100000:3.0:1788940512.086594:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 180 00000100:00100000:3.0:1788940512.086606:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+33:11533:x1875839718341632:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788940512.086767:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+33:11533:x1875839718341632:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 Request processed in 162us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940512.086776:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 180 00000100:00100000:2.0:1788940512.093934:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940512.094091:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718341760 00000100:00100000:3.0:1788940512.094116:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718341760 00000100:00100000:3.0:1788940512.094204:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 181 00000100:00100000:3.0:1788940512.094218:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+33:11533:x1875839718341760:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788940512.094261:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940512.094293:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b704 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5a28 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.094431:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97600/0x27a633fcdd4b70b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.094454:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97600/0x27a633fcdd4b70b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.094472:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97600/0x27a633fcdd4b70b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940512.094565:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788940512.094906:0:5862:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97600/0x27a633fcdd4b70b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.094946:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031800/0x27a633fcdd4b704 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a28 expref: 35 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.094971:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97600/0x27a633fcdd4b70b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a28 expref: 34 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.094979:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff89f18a6ceb00) 00010000:00010000:3.0:1788940512.094983:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788940512.094988:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f1bfa97600, rc 0) 00000100:00100000:3.0:1788940512.095072:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+34:11533:x1875839718341760:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 857us (1152us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940512.095080:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 181 00000100:00100000:2.0:1788940512.113379:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940512.113803:0:12095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718341888 00000100:00100000:1.0:1788940512.113818:0:12095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718341888 00000100:00100000:1.0:1788940512.113915:0:12095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 52 00000100:00100000:1.0:1788940512.113928:0:12095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9c51ff78-d02d-4e61-8a10-a2f8830f1679+7:2353:x1875839718341888:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788940512.113968:0:12095:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940512.113994:0:12095:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf131944/0x27a633fcdd4b712 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5a2f expref: -99 pid: 12095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788940512.114029:0:12095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa110e1, blocks: 0x1 00010000:00010000:1.0:1788940512.114056:0:12095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=455s v=(0 0) 00010000:00010000:1.0:1788940512.114061:0:12095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940512.114075:0:12095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf131944/0x27a633fcdd4b712 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a2f expref: 8 pid: 12095 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940512.114099:0:12095:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bf131944/0x27a633fcdd4b712 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a2f expref: 8 pid: 12095 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940512.114115:0:12095:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f19258d800, rc 0) 00000100:00100000:1.0:1788940512.114206:0:12095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9c51ff78-d02d-4e61-8a10-a2f8830f1679+8:2353:x1875839718341888:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 279us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940512.114214:0:12095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 52 00000100:00100000:0.0:1788940512.123793:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940512.123920:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718342144 00000100:00100000:3.0:1788940512.123935:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718342144 00000100:00100000:3.0:1788940512.124013:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 182 00000100:00100000:3.0:1788940512.124025:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf97c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+34:11533:x1875839718342144:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788940512.124361:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf97c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+34:11533:x1875839718342144:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 Request processed in 336us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940512.124371:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 182 00000100:00100000:1.0:1788940512.138292:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940512.138353:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718342272 00000100:00100000:1.0:1788940512.138367:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718342272 00000100:00100000:1.0:1788940512.138440:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 53 00000100:00100000:1.0:1788940512.138451:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1baadea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+8:11533:x1875839718342272:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788940512.138475:0:6707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940512.138502:0:6707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008923fba9/0x27a633fcdd4b719 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5a36 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940512.139767:0:6707:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bf131944/0x27a633fcdd4b712 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a2f expref: 9 pid: 12095 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940512.139785:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940512.139791:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940512.139798:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008923fba9/0x27a633fcdd4b719 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a36 expref: 9 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940512.139844:0:6707:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bf131944/0x27a633fcdd4b712 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a2f expref: 9 pid: 12095 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940512.139860:0:6707:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bf131944/0x27a633fcdd4b712 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a2f expref: 9 pid: 12095 timeout: 555 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940512.139877:0:6707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1baade300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6707:1875839738265600:192.168.202.14@tcp:104: 00000100:00100000:1.0:1788940512.140008:0:6707:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1841b3600 going to sleep for 11 seconds 00000100:00100000:2.0:1788940512.146138:0:6707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1baade300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6707:1875839738265600:192.168.202.14@tcp:104: 00010000:00010000:2.0:1788940512.146195:0:6707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008923fba9/0x27a633fcdd4b719 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a36 expref: 9 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940512.146225:0:6707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f19258cc00, rc 0) 00000100:00100000:2.0:1788940512.146326:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1baadea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+9:11533:x1875839718342272:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 7874us (9346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940512.146352:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 53 00000100:00100000:0.0:1788940512.147234:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940512.147375:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718342400 00000100:00100000:3.0:1788940512.147386:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718342400 00010000:00010000:3.0:1788940512.147429:0:8470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bf131944/0x27a633fcdd4b712 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a2f expref: 9 pid: 12095 timeout: 555 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940512.147487:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 69 00000100:00100000:3.0:1788940512.147497:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf97ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+9:2352:x1875839718342400:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940512.147513:0:8470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940512.147569:0:8470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bf131944/0x27a633fcdd4b712 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a2f expref: 9 pid: 12095 timeout: 555 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.147754:0:8470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bf131944/0x27a633fcdd4b712 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a2f expref: 9 pid: 12095 timeout: 555 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.147787:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf131944/0x27a633fcdd4b712 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a2f expref: 9 pid: 12095 timeout: 555 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.147807:0:8470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940512.147813:0:8470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940512.147824:0:8470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008923fba9/0x27a633fcdd4b719 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a36 expref: 8 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.147836:0:8470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008923fba9/0x27a633fcdd4b719 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a36 expref: 8 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.147886:0:8470:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008923fba9/0x27a633fcdd4b719 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a36 expref: 8 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940512.147905:0:8470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae81d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8470:1875839738265728:192.168.202.14@tcp:105: 00000100:00100000:3.0:1788940512.150847:0:8470:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f195ed3b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788940512.155328:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940512.155498:0:8470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae81d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8470:1875839738265728:192.168.202.14@tcp:105: 00010000:00010000:3.0:1788940512.155798:0:8470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940512.155911:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf97ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+8:2352:x1875839718342400:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 8413us (8681us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940512.155925:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 69 00000100:00100000:3.0:1788940512.155977:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718342528 00000100:00100000:3.0:1788940512.155984:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718342528 00002000:00100000:3.0:1788940512.156046:0:6711:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff89f1baadce00 x1875839718342528/t0(0) o4->9c51ff78-d02d-4e61-8a10-a2f8830f1679@192.168.202.14@tcp:488/0 lens 504/0 e 0 to 0 dl 1788940523 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788940512.156058:0:6711:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89f1baadce00 with x1875839718342528 ext(0->8) 00002000:00010000:3.0:1788940512.156064:0:6711:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89f1baadce00 00000100:00100000:3.0:1788940512.156094:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 4 00000100:00100000:3.0:1788940512.156105:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1baadce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+8:2352:x1875839718342528:12345-192.168.202.14@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788940512.156871:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1baadce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+10:2352:x1875839718342528:12345-192.168.202.14@tcp:4:lhsmtool_posix.0 Request processed in 764us (1555us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1788940512.156881:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 4 00002000:00100000:3.0:1788940512.156889:0:6711:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff89f1baadce00 x1875839718342528/t4294967314(0) o4->9c51ff78-d02d-4e61-8a10-a2f8830f1679@192.168.202.14@tcp:488/0 lens 504/448 e 0 to 0 dl 1788940523 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788940512.156899:0:6711:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89f1baadce00 with x1875839718342528 ext(0->8) 00002000:00010000:3.0:1788940512.156903:0:6711:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89f1baadce00 00000100:00100000:1.0:1788940512.160812:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940512.160920:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718342656 00000100:00100000:3.0:1788940512.160935:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718342656 00000100:00100000:3.0:1788940512.161075:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 183 00000100:00100000:3.0:1788940512.161087:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1baade680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+34:11533:x1875839718342656:12345-192.168.202.14@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1788940512.222509:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1baade680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+34:11533:x1875839718342656:12345-192.168.202.14@tcp:44:lhsmtool_posix.0 Request processed in 61412us (61939us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940512.222548:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 183 00000001:00080000:1.0:1788940512.222781:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967461 is committed 00000004:00080000:1.0:1788940512.222796:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:1.0:1788940512.222836:0:5883:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:1.0:1788940512.223041:0:5894:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:1.0:1788940512.223060:0:5894:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1788940512.223082:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1baade300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738265856:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788940512.223227:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940512.223859:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738265856 00000100:00100000:1.0:1788940512.223871:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738265856 00000100:00100000:1.0:1788940512.223930:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788940512.223941:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1baadf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738265856:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788940512.225936:0:6708:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788940512.225947:0:6708:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788940513 00002000:00010000:1.0:1788940512.225951:0:6708:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788940512.225953:0:6708:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788940513 -> 1788940513 00002000:00010000:1.0:1788940512.225956:0:6708:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788940512.226275:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1baadf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1875839738265856:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2332us (3044us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1788940512.226288:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1788940512.226403:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1788940512.226550:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89f1baade300/2, rc 0, transno 4294967315 00000100:00100000:2.0:1788940512.226559:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1baade300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738265856:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788940512.229850:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940512.229948:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718342784 00000100:00100000:3.0:1788940512.229962:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718342784 00000100:00100000:3.0:1788940512.230062:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 55 00000100:00100000:3.0:1788940512.230075:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf97e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+10:2353:x1875839718342784:12345-192.168.202.14@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788940512.251088:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940512.251433:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940512.251469:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940512.251511:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718343168 00000100:00100000:3.0:1788940512.251538:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718343168 00000100:00100000:0.0:1788940512.251756:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718342912 00000100:00100000:0.0:1788940512.251762:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718342912 00000100:00100000:0.0:1788940512.251808:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 309 00000100:00100000:0.0:1788940512.251820:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18416e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:2350:x1875839718342912:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788940512.251921:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18416e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:2350:x1875839718342912:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 103us (1407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940512.251930:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 309 00000100:00100000:3.0:1788940512.252264:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 179 00000100:00100000:3.0:1788940512.252274:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae81d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffa310cd-169f-42e3-8999-506116bada08+5:2350:x1875839718343168:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788940512.252319:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae81d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffa310cd-169f-42e3-8999-506116bada08+5:2350:x1875839718343168:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 47us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940512.252326:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 179 00000100:00100000:3.0:1788940512.252357:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718343040 00000100:00100000:3.0:1788940512.252362:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718343040 00000100:00100000:3.0:1788940512.252411:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 100 00000100:00100000:3.0:1788940512.252419:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae81c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+7:2350:x1875839718343040:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788940512.252455:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae81c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+7:2350:x1875839718343040:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 37us (986us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940512.252462:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 100 00000100:00080000:3.0:1788940512.252484:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788940512.252489:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1788940512.285358:0:7662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:3.0:1788940512.285384:0:7662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:3.0:1788940512.285391:0:7662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:1.0:1788940512.330181:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000001:00080000:1.0:1788940512.330213:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:1.0:1788940512.330221:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:3.0:1788940512.333622:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf97e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+7:2353:x1875839718342784:12345-192.168.202.14@tcp:16:lhsmtool_posix.0 Request processed in 103531us (103771us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940512.333643:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 55 00000100:00100000:3.0:1788940512.336500:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940512.336625:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718343424 00000100:00100000:2.0:1788940512.336637:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718343424 00000100:00100000:2.0:1788940512.336720:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 184 00000100:00100000:2.0:1788940512.336731:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae81d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+18:11533:x1875839718343424:12345-192.168.202.14@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788940512.336806:0:7857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940512.336845:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97600/0x27a633fcdd4b70b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a28 expref: 18 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940512.336870:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff89f18a6ceb00) 00010000:00010000:2.0:1788940512.336877:0:7857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788940512.336918:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b720 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940512.336935:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b720 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940512.336947:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b720 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788940512.337486:0:7857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e1480f80 reply state 000000009ab49675 transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b720 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940512.337499:0:7857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788940512.352014:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae81d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+19:11533:x1875839718343424:12345-192.168.202.14@tcp:36:lhsmtool_posix.0 Request processed in 15256us (15511us total) trans 4294967462 rc 0/0 00000100:00100000:2.0:1788940512.352057:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 184 00000100:00100000:2.0:1788940512.361939:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940512.361983:0:12095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718343552 00000100:00100000:2.0:1788940512.362006:0:12095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718343552 00000100:00100000:2.0:1788940512.362067:0:12095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 56 00000100:00100000:2.0:1788940512.362077:0:12095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9c51ff78-d02d-4e61-8a10-a2f8830f1679+7:2352:x1875839718343552:12345-192.168.202.14@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788940512.362437:0:12095:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1788940512.362443:0:12095:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788940513 -> 1788940512 00002000:00010000:2.0:1788940512.362446:0:12095:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788940510 00002000:00010000:2.0:1788940512.362449:0:12095:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788940513 -> 1788940512 00002000:00010000:2.0:1788940512.362452:0:12095:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788940512.362557:0:12095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9c51ff78-d02d-4e61-8a10-a2f8830f1679+8:2352:x1875839718343552:12345-192.168.202.14@tcp:2:lhsmtool_posix.0 Request processed in 480us (634us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788940512.362565:0:12095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 56 00010000:00010000:3.0:1788940512.364328:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b720 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.364350:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b720 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.364360:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b720 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.364368:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188daaa00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940512.364375:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b720 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.364387:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b720 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.364411:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff89f18a6ceb00) 00010000:00010000:3.0:1788940512.364415:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940512.364422:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b720 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.364429:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b720 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940512.366385:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940512.366557:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718343808 00000100:00100000:2.0:1788940512.366571:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718343808 00000100:00100000:2.0:1788940512.366642:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 185 00000100:00100000:2.0:1788940512.366653:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae81fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+18:11533:x1875839718343808:12345-192.168.202.14@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788940512.366762:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4b727 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940512.366784:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b6ef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a1a expref: 18 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940512.366794:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4b727 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940512.366866:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b6ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a1a expref: 18 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940512.366884:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b6ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a1a expref: 18 pid: 5862 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940512.366904:0:5861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bfbf2680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5861:1875839738265984:192.168.202.14@tcp:104: 00000100:00100000:2.0:1788940512.367151:0:5861:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f195ed3d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788940512.371086:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940512.371134:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718343936 00000100:00100000:2.0:1788940512.371145:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718343936 00010000:00010000:2.0:1788940512.371214:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b6ef lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a1a expref: 19 pid: 5862 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940512.371265:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 70 00000100:00100000:2.0:1788940512.371277:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbf0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+19:2352:x1875839718343936:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788940512.371297:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940512.371307:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b6ef lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a1a expref: 19 pid: 5862 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940512.371322:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b6ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a1a expref: 19 pid: 5862 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940512.371353:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff89f18a6ceb00) 00010000:00010000:2.0:1788940512.371360:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4b727 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940512.371396:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4b727 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940512.371407:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4b727 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940512.371438:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940512.371550:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbf0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+19:2352:x1875839718343936:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 243us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940512.371559:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 70 00010000:00010000:3.0:1788940512.374282:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030400/0x27a633fcdd4b6ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a1a expref: 18 pid: 5862 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940512.374333:0:5861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bfbf2680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5861:1875839738265984:192.168.202.14@tcp:104: 00010000:00010000:3.0:1788940512.374369:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4b727 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.374382:0:5861:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4b727 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.374390:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4b727 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.374445:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4b727 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.374454:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4b727 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.374464:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4b727 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.374472:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188dab600 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940512.374479:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4b727 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.374504:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4b727 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.374542:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff89f18a6ceb00) 00010000:00010000:3.0:1788940512.374547:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788940512.374553:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4b727 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.374571:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4b727 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940512.374678:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae81fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+17:11533:x1875839718343808:12345-192.168.202.14@tcp:55:lhsmtool_posix.0 Request processed in 8026us (8308us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788940512.374690:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 185 00000100:00100000:2.0:1788940512.378729:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940512.378810:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718344064 00000100:00100000:3.0:1788940512.378823:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718344064 00000100:00100000:3.0:1788940512.378901:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 57 00000100:00100000:3.0:1788940512.378913:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+8:2353:x1875839718344064:12345-192.168.202.14@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788940512.378979:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d18e7f45/0x27a633fcdd4b72e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.379016:0:6707:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008923fba9/0x27a633fcdd4b719 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a36 expref: 8 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.379027:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940512.379033:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788940512.379038:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d18e7f45/0x27a633fcdd4b72e lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.379086:0:6707:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008923fba9/0x27a633fcdd4b719 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a36 expref: 8 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.379102:0:6707:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008923fba9/0x27a633fcdd4b719 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a36 expref: 8 pid: 6707 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940512.379146:0:6707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae81ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6707:1875839738266112:192.168.202.14@tcp:104: 00000100:00100000:3.0:1788940512.379268:0:6707:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1b8bc1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788940512.395554:0:6707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae81ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6707:1875839738266112:192.168.202.14@tcp:104: 00010000:00010000:3.0:1788940512.395603:0:6707:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d18e7f45/0x27a633fcdd4b72e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940512.413210:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940512.413287:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718344192 00000100:00100000:2.0:1788940512.413310:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718344192 00010000:00010000:2.0:1788940512.413364:0:5845:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008923fba9/0x27a633fcdd4b719 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a36 expref: 9 pid: 6707 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940512.413410:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 71 00000100:00100000:2.0:1788940512.413422:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbf1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+9:2352:x1875839718344192:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788940512.413440:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940512.413472:0:5845:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008923fba9/0x27a633fcdd4b719 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a36 expref: 9 pid: 6707 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940512.413489:0:5845:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008923fba9/0x27a633fcdd4b719 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a36 expref: 9 pid: 6707 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940512.413563:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008923fba9/0x27a633fcdd4b719 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a36 expref: 9 pid: 6707 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940512.413604:0:5845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788940512.413609:0:5845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788940512.413622:0:5845:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d18e7f45/0x27a633fcdd4b72e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940512.413634:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d18e7f45/0x27a633fcdd4b72e lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940512.413669:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940512.414454:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbf1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+8:2352:x1875839718344192:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 1027us (1252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940512.414466:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 71 00010000:00010000:2.0:1788940512.414514:0:6707:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d18e7f45/0x27a633fcdd4b72e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940512.414550:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d18e7f45/0x27a633fcdd4b72e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940512.414589:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d18e7f45/0x27a633fcdd4b72e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940512.414598:0:6707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d18e7f45/0x27a633fcdd4b72e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940512.414607:0:6707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d18e7f45/0x27a633fcdd4b72e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940512.414628:0:6707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1bfa97a00 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:2.0:1788940512.414634:0:6707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d18e7f45/0x27a633fcdd4b72e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940512.414644:0:6707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d18e7f45/0x27a633fcdd4b72e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940512.414661:0:6707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d18e7f45/0x27a633fcdd4b72e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940512.414670:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d18e7f45/0x27a633fcdd4b72e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940512.414745:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+7:2353:x1875839718344064:12345-192.168.202.14@tcp:1:lhsmtool_posix.0 Request processed in 35834us (36031us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940512.414755:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 57 00000100:00100000:3.0:1788940512.418550:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940512.418605:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718344448 00000100:00100000:3.0:1788940512.418619:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718344448 00000100:00100000:3.0:1788940512.418706:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 186 00000100:00100000:3.0:1788940512.418718:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae81ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+17:11533:x1875839718344448:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788940512.418834:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96c00/0x27a633fcdd4b735 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.418859:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96c00/0x27a633fcdd4b735 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.418874:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96c00/0x27a633fcdd4b735 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.419176:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96400/0x27a633fcdd4b73c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.419191:0:5862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b6fd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a21 expref: 18 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.419223:0:5862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96400/0x27a633fcdd4b73c lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.419277:0:5862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b6fd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a21 expref: 18 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.419294:0:5862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b6fd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a21 expref: 18 pid: 5862 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940512.419313:0:5862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae81d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5862:1875839738266240:192.168.202.14@tcp:104: 00000100:00100000:3.0:1788940512.419418:0:5862:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1b8bc1a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788940512.428684:0:5862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae81d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5862:1875839738266240:192.168.202.14@tcp:104: 00010000:00010000:0.0:1788940512.428743:0:5862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96400/0x27a633fcdd4b73c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940512.429228:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940512.429326:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718344576 00000100:00100000:0.0:1788940512.429335:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718344576 00010000:00010000:0.0:1788940512.429381:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b6fd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a21 expref: 19 pid: 5862 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940512.429432:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 72 00000100:00100000:0.0:1788940512.429443:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae81c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+19:2353:x1875839718344576:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940512.429459:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940512.429468:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b6fd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a21 expref: 19 pid: 5862 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940512.429482:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b6fd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a21 expref: 19 pid: 5862 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940512.429565:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030a00/0x27a633fcdd4b6fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a21 expref: 19 pid: 5862 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940512.429587:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff89f18a6ceb00) 00010000:00010000:0.0:1788940512.429593:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96400/0x27a633fcdd4b73c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940512.429605:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96400/0x27a633fcdd4b73c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940512.429613:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96400/0x27a633fcdd4b73c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940512.429643:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788940512.429926:0:5862:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96400/0x27a633fcdd4b73c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940512.429937:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96400/0x27a633fcdd4b73c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788940512.430217:0:5862:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:1.0:1788940512.430431:0:5862:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:1.0:1788940512.430484:0:5862:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:1.0:1788940512.430617:0:5862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1baadf800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5862:1875839738266368:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788940512.430718:0:5862:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940512.431127:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae81c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+21:2353:x1875839718344576:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 1681us (1897us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940512.431139:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 72 00000100:00100000:3.0:1788940512.433055:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738266368 00000100:00100000:3.0:1788940512.433074:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738266368 00000100:00100000:3.0:1788940512.433162:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788940512.433175:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1baadf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5862:x1875839738266368:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788940512.433337:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1baadf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5862:x1875839738266368:12345-0@lo:1000:mdt00_002.0 Request processed in 165us (2618us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940512.433345:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788940512.433981:0:5862:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1baa6ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1788940512.434032:0:5862:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:0.0:1788940512.434040:0:5862:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89f1baade300, transno 4294967315 00000100:00100000:0.0:1788940512.434097:0:5862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1baadf800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5862:1875839738266368:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1788940512.435100:0:5862:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:0.0:1788940512.435220:0:5862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf97d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5862:1875839738266496:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788940512.435418:0:5862:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940512.435755:0:5862:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1baa6a900 going to sleep for 11 seconds 00000100:00100000:3.0:1788940512.436835:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738266496 00000100:00100000:3.0:1788940512.436847:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738266496 00000100:00100000:0.0:1788940512.437949:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788940512.437964:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b48a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5862:x1875839738266496:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788940512.438346:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b48a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5862:x1875839738266496:12345-0@lo:1000:mdt00_002.0 Request processed in 384us (2927us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1788940512.438354:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788940512.438425:0:5862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf97d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5862:1875839738266496:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1788940512.438500:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96400/0x27a633fcdd4b73c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940512.438513:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96400/0x27a633fcdd4b73c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940512.438546:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96400/0x27a633fcdd4b73c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940512.438552:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1bfa96400 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:0.0:1788940512.438557:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96400/0x27a633fcdd4b73c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940512.438566:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96400/0x27a633fcdd4b73c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940512.438586:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff89f18a6ceb00) 00010000:00010000:0.0:1788940512.438590:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788940512.438597:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96400/0x27a633fcdd4b73c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940512.438605:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96400/0x27a633fcdd4b73c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940512.438653:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b678 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940512.438671:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b678 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940512.438676:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b678 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940512.438681:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f180030000 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:0.0:1788940512.438683:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b678 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940512.438689:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b678 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940512.438698:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89f18a6ce700) 00010000:00010000:0.0:1788940512.438701:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788940512.438704:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b678 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940512.438709:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030000/0x27a633fcdd4b678 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940512.438736:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b743 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940512.438753:0:5862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b694 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a05 expref: 21 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940512.438764:0:5862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b743 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940512.438807:0:5862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b694 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a05 expref: 21 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940512.438832:0:5862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b694 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a05 expref: 21 pid: 7857 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940512.438851:0:5862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b48a6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5862:1875839738266624:192.168.202.14@tcp:104: 00000100:00100000:0.0:1788940512.438956:0:5862:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f18dea0000 going to sleep for 11 seconds 00000100:00100000:3.0:1788940512.444500:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940512.445016:0:5862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b48a6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5862:1875839738266624:192.168.202.14@tcp:104: 00010000:00010000:1.0:1788940512.445052:0:5862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b743 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940512.445589:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718344704 00000100:00100000:1.0:1788940512.445600:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718344704 00010000:00010000:1.0:1788940512.445651:0:5845:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b694 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a05 expref: 22 pid: 7857 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940512.445703:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 73 00000100:00100000:1.0:1788940512.445715:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae81d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+22:2353:x1875839718344704:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788940512.445733:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940512.445741:0:5845:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b694 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a05 expref: 22 pid: 7857 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940512.445755:0:5845:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b694 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a05 expref: 22 pid: 7857 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940512.445782:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031600/0x27a633fcdd4b694 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a05 expref: 22 pid: 7857 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940512.445803:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89f18a6ce700) 00010000:00010000:1.0:1788940512.445809:0:5845:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b743 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940512.445821:0:5845:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b743 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940512.445850:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b743 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940512.445879:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940512.445951:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae81d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+21:2353:x1875839718344704:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 237us (1475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940512.445959:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 73 00010000:00010000:1.0:1788940512.446007:0:5862:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b743 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940512.446015:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b743 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940512.446031:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b743 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940512.446038:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b743 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940512.446046:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b743 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940512.446053:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad2800 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940512.446059:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b743 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940512.446068:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b743 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940512.446078:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89f18a6ce700) 00010000:00010000:1.0:1788940512.446081:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940512.446092:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b743 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940512.446100:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b743 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940512.446113:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96c00/0x27a633fcdd4b735 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940512.446120:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96c00/0x27a633fcdd4b735 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940512.446126:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96c00/0x27a633fcdd4b735 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940512.446132:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1bfa96c00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940512.446135:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96c00/0x27a633fcdd4b735 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940512.446141:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96c00/0x27a633fcdd4b735 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940512.446148:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89f18a6ce700) 00010000:00010000:1.0:1788940512.446151:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788940512.446153:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96c00/0x27a633fcdd4b735 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940512.446159:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96c00/0x27a633fcdd4b735 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940512.446436:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae81ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+20:11533:x1875839718344448:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 Request processed in 27719us (27916us total) trans 4294967467 rc 0/0 00000100:00100000:1.0:1788940512.446446:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 186 00000020:00080000:1.0:1788940512.446456:0:5862:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1788940512.449166:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940512.449324:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718344960 00000100:00100000:1.0:1788940512.449336:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718344960 00000100:00100000:1.0:1788940512.449408:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 50 00000100:00100000:1.0:1788940512.449421:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b0613c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+20:11533:x1875839718344960:12345-192.168.202.14@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788940512.450374:0:5864:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788940512.450505:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967468 00010000:00010000:1.0:1788940512.450605:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4b74a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940512.450627:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4b74a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940512.450641:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4b74a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940512.450650:0:5864:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4b74a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940512.450658:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4b74a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940512.450665:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4b74a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940512.450691:0:5864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788940512.450826:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b0613c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+22:11533:x1875839718344960:12345-192.168.202.14@tcp:35:lhsmtool_posix.0 Request processed in 1404us (1671us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1788940512.450836:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 50 00000020:00080000:1.0:1788940512.450842:0:5864:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788940512.450918:0:7648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940512.450936:0:7648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4b74a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940512.450944:0:7648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258c600 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:1.0:1788940512.450949:0:7648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4b74a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940512.450959:0:7648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4b74a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940512.450976:0:7648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff89f188f81b00) 00010000:00010000:1.0:1788940512.450979:0:7648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788940512.450986:0:7648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4b74a lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940512.450993:0:7648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4b74a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940512.451011:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940512.451013:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940512.451015:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788940512.453398:0:11708:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788940512.453410:0:11708:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788940512.456348:0:11708:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1788940512.456373:0:11708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1788940512.585987:0:12543:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788940512.586771:0:12543:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788940512.586862:0:12543:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1788940512.586871:0:12543:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788940512.749765:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bfbf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875839738266880:0@lo:400:kworker.0 00000100:00100000:2.0:1788940512.749859:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940512.749930:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788940512.749938:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bfbf0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3308:1875839738266752:0@lo:400:kworker.0 00000100:00100000:2.0:1788940512.749975:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940512.750014:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1aed96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738267264:0@lo:400:kworker.0 00000100:00100000:2.0:1788940512.750060:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940512.750096:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bff63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875839738267008:0@lo:400:kworker.0 00000100:00100000:2.0:1788940512.750125:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940512.750146:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788940512.750151:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1aed94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875839738267136:0@lo:400:kworker.0 00000100:00100000:2.0:1788940512.750171:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940512.750204:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738266880 00000100:00100000:2.0:1788940512.750212:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738266880 00000100:00100000:2.0:1788940512.750268:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738267008 00000100:00100000:2.0:1788940512.750271:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738267008 00000100:00100000:2.0:1788940512.750293:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738267136 00000100:00100000:2.0:1788940512.750296:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738267136 00000100:00100000:2.0:1788940512.750313:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788940512.750321:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1aed95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875839738266880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940512.750373:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1aed95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875839738266880:12345-0@lo:400:kworker.0 Request processed in 53us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940512.750380:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788940512.750398:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788940512.750403:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5624700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875839738267008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940512.750428:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5624700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875839738267008:12345-0@lo:400:kworker.0 Request processed in 25us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940512.750433:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788940512.750442:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788940512.750447:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5627480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875839738267136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940512.750467:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5627480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875839738267136:12345-0@lo:400:kworker.0 Request processed in 20us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940512.750496:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788940512.750514:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738266752 00000100:00100000:2.0:1788940512.750540:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738266752 00000100:00100000:2.0:1788940512.750566:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1788940512.750572:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18416f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3308:x1875839738266752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940512.750603:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18416f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3308:x1875839738266752:12345-0@lo:400:kworker.0 Request processed in 32us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940512.750610:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1788940512.750640:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738267264 00000100:00100000:2.0:1788940512.750643:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738267264 00000100:00100000:2.0:1788940512.750677:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788940512.750684:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5625500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738267264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940512.750717:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5625500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738267264:12345-0@lo:400:kworker.0 Request processed in 34us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940512.750723:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:2.0:1788940512.750758:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788940512.750763:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940512.750805:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1aed94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875839738267136:0@lo:400:kworker.0 00000100:00100000:2.0:1788940512.750817:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bff63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875839738267008:0@lo:400:kworker.0 00000100:00100000:2.0:1788940512.750852:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bfbf0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3308:1875839738266752:0@lo:400:kworker.0 00000100:00100000:2.0:1788940512.750861:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:2.0:1788940512.750867:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:2.0:1788940512.750889:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89f1b5835c00, transno 4294967307 00000100:00100000:2.0:1788940512.750901:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1aed96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738267264:0@lo:400:kworker.0 00000100:00100000:2.0:1788940512.750913:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bfbf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875839738266880:0@lo:400:kworker.0 00000100:00100000:2.0:1788940512.759973:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1baade300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738267392:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788940512.760089:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940512.760186:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738267392 00000100:00100000:3.0:1788940512.760197:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738267392 00000100:00100000:3.0:1788940512.760277:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788940512.760289:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5625f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875839738267392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788940512.760333:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:1.0:1788940512.760474:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940512.760548:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718345216 00000100:00100000:1.0:1788940512.760553:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718345216 00000100:00100000:1.0:1788940512.760592:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 187 00000100:00100000:1.0:1788940512.760601:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1baaddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+22:11543:x1875839718345216:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:1.0:1788940512.760625:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940512.760659:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ce00/0x27a633fcdd4b751 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5a3d expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940512.760796:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b758 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940512.760815:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b758 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940512.760831:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b758 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940512.760845:0:5860:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788940512.761022:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ce00/0x27a633fcdd4b751 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a3d expref: 25 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940512.761045:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b758 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a3d expref: 24 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940512.761055:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89f1983af600) 00010000:00010000:1.0:1788940512.761059:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788940512.761064:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f19258c400, rc 0) 00000100:00100000:1.0:1788940512.761123:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1baaddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+24:11543:x1875839718345216:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 523us (651us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1788940512.761131:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 187 00000100:00100000:3.0:1788940512.769114:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5625f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875839738267392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8804us (9002us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940512.769137:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788940512.769504:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940512.771487:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1baade300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738267392:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788940512.771674:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718345344 00000100:00100000:3.0:1788940512.771692:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718345344 00000100:00100000:3.0:1788940512.771771:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 188 00000100:00100000:3.0:1788940512.771783:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1baadf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+24:11543:x1875839718345344:12345-192.168.202.14@tcp:34:lfs.0 00010000:00010000:3.0:1788940512.771888:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97000/0x27a633fcdd4b766 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.771912:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97000/0x27a633fcdd4b766 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.771926:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97000/0x27a633fcdd4b766 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.771946:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96000/0x27a633fcdd4b76d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.771953:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96000/0x27a633fcdd4b76d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.771960:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96000/0x27a633fcdd4b76d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.772446:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97e00/0x27a633fcdd4b774 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.772456:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97e00/0x27a633fcdd4b774 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.772473:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97e00/0x27a633fcdd4b774 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788940512.772574:0:7857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97e00/0x27a633fcdd4b774 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.772590:0:7857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97000/0x27a633fcdd4b766 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.772598:0:7857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97000/0x27a633fcdd4b766 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.772605:0:7857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97000/0x27a633fcdd4b766 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.772612:0:7857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1bfa97000 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940512.772616:0:7857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97000/0x27a633fcdd4b766 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.772625:0:7857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97000/0x27a633fcdd4b766 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.772638:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89f1983af600) 00010000:00010000:3.0:1788940512.772640:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940512.772647:0:7857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97000/0x27a633fcdd4b766 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.772653:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97000/0x27a633fcdd4b766 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.772665:0:7857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96000/0x27a633fcdd4b76d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.772678:0:7857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96000/0x27a633fcdd4b76d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.772851:0:7857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96000/0x27a633fcdd4b76d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.772856:0:7857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1bfa96000 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940512.772859:0:7857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96000/0x27a633fcdd4b76d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.772866:0:7857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96000/0x27a633fcdd4b76d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.772874:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff89f18a6ce500) 00010000:00010000:3.0:1788940512.772877:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940512.772880:0:7857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96000/0x27a633fcdd4b76d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.772885:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96000/0x27a633fcdd4b76d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.772904:0:7857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97e00/0x27a633fcdd4b774 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.772910:0:7857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97e00/0x27a633fcdd4b774 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.772915:0:7857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97e00/0x27a633fcdd4b774 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.772920:0:7857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1bfa97e00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940512.772929:0:7857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97e00/0x27a633fcdd4b774 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.772935:0:7857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97e00/0x27a633fcdd4b774 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.772943:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89f18a6cee00) 00010000:00010000:3.0:1788940512.772946:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940512.772949:0:7857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97e00/0x27a633fcdd4b774 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.772954:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97e00/0x27a633fcdd4b774 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940512.773202:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1baadf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+24:11543:x1875839718345344:12345-192.168.202.14@tcp:34:lfs.0 Request processed in 1416us (3698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940512.773215:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 188 00000100:00100000:3.0:1788940512.850436:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940512.850605:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718345600 00000100:00100000:2.0:1788940512.850619:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718345600 00000100:00100000:2.0:1788940512.850703:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 189 00000100:00100000:2.0:1788940512.850714:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae81ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+24:11546:x1875839718345600:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:2.0:1788940512.850744:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940512.850772:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b77b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5a44 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940512.850873:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4b782 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940512.850891:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4b782 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940512.850905:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4b782 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940512.850921:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4b789 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940512.850928:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4b789 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940512.850951:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4b789 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940512.851336:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b790 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940512.851345:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b790 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940512.851353:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b790 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940512.851365:0:5860:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1788940512.851508:0:5860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4b782 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940512.851547:0:5860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4b782 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940512.851554:0:5860:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4b782 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940512.851561:0:5860:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188dab400 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940512.851566:0:5860:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4b782 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940512.851574:0:5860:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4b782 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940512.851587:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89f1983af600) 00010000:00010000:2.0:1788940512.851590:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940512.851604:0:5860:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4b782 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940512.851612:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4b782 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940512.851627:0:5860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4b789 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940512.851633:0:5860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4b789 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940512.851639:0:5860:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4b789 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940512.851645:0:5860:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188daa400 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940512.851648:0:5860:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4b789 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940512.851655:0:5860:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4b789 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940512.851662:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff89f186946f00) 00010000:00010000:2.0:1788940512.851665:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940512.851668:0:5860:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4b789 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940512.851675:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4b789 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940512.851728:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b77b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a44 expref: 27 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940512.851756:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b790 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a44 expref: 26 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940512.851764:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89f186946100) 00010000:00010000:2.0:1788940512.851767:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788940512.851769:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f188daac00, rc 0) 00000100:00100000:2.0:1788940512.851858:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae81ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+26:11546:x1875839718345600:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 1145us (1437us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1788940512.851867:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 189 00000100:00100000:1.0:1788940512.866227:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940512.870222:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718345728 00000100:00100000:2.0:1788940512.870252:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718345728 00000100:00100000:2.0:1788940512.870343:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 190 00000100:00100000:2.0:1788940512.870355:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1baade300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+26:11546:x1875839718345728:12345-192.168.202.14@tcp:54:lfs.0 00010000:00010000:2.0:1788940512.870452:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b79e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940512.870474:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b79e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940512.870489:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b79e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940512.870544:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b79e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940512.870553:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b79e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940512.870579:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b79e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940512.870585:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188daaa00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940512.870590:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b79e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940512.870600:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b79e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940512.870614:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89f186946100) 00010000:00010000:2.0:1788940512.870618:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788940512.870624:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b79e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940512.870631:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b79e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940512.870815:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1baade300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+26:11546:x1875839718345728:12345-192.168.202.14@tcp:54:lfs.0 Request processed in 460us (4601us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940512.870823:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 190 00000100:00100000:3.0:1788940512.880086:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940512.880171:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718345984 00000100:00100000:1.0:1788940512.880184:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718345984 00000100:00100000:1.0:1788940512.880259:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 51 00000100:00100000:1.0:1788940512.880281:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf583b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+26:11546:x1875839718345984:12345-192.168.202.14@tcp:35:lfs.0 00000100:00100000:1.0:1788940512.880623:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf583b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+27:11546:x1875839718345984:12345-192.168.202.14@tcp:35:lfs.0 Request processed in 344us (552us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1788940512.880632:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 51 00010000:00010000:0.0:1788940512.954822:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940512.957255:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940512.957310:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718346240 00000100:00100000:0.0:1788940512.957325:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718346240 00000100:00100000:0.0:1788940512.957398:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 191 00000100:00100000:0.0:1788940512.957411:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b48a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+27:11080:x1875839718346240:12345-192.168.202.14@tcp:101:bash.0 00010000:00010000:0.0:1788940512.957449:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940512.957478:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b7a5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5a4b expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940512.957662:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b7ac lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940512.957684:0:5860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b790 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a44 expref: 28 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940512.957694:0:5860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b7ac lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940512.957739:0:5860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b790 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a44 expref: 28 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940512.957774:0:5860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b790 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a44 expref: 28 pid: 5860 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940512.957792:0:5860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b48a5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5860:1875839738267520:192.168.202.14@tcp:104: 00000100:00100000:0.0:1788940512.957906:0:5860:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f18dea0b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788940512.964476:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940512.964807:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718346368 00000100:00100000:3.0:1788940512.964820:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718346368 00010000:00010000:3.0:1788940512.964876:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b790 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a44 expref: 29 pid: 5860 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940512.964929:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 74 00000100:00100000:3.0:1788940512.964941:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf97dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+29:2353:x1875839718346368:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940512.964958:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940512.964966:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b790 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a44 expref: 29 pid: 5860 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.964982:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b790 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a44 expref: 29 pid: 5860 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.965155:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89f186946100) 00010000:00010000:3.0:1788940512.965163:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b7ac lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.965176:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b7ac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.965185:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b7ac lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940512.965209:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940512.965298:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf97dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+29:2353:x1875839718346368:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 359us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940512.965308:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 74 00010000:00010000:0.0:1788940512.967118:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b790 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a44 expref: 28 pid: 5860 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940512.967148:0:5860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b48a5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5860:1875839738267520:192.168.202.14@tcp:104: 00010000:00010000:0.0:1788940512.967179:0:5860:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b7ac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940512.967190:0:5860:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b7ac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940512.967197:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b7ac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940512.967225:0:5860:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1788940512.967454:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b7a5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a4b expref: 29 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940512.967474:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b7ac lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a4b expref: 28 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940512.967644:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89f186946100) 00010000:00010000:0.0:1788940512.967662:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788940512.967666:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f082ad2600, rc 0) 00000100:00100000:0.0:1788940512.967859:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b48a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+28:11080:x1875839718346240:12345-192.168.202.14@tcp:101:bash.0 Request processed in 10449us (10628us total) trans 4294967473 rc 0/0 00000100:00100000:0.0:1788940512.967869:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 191 00000100:00100000:3.0:1788940512.971101:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940512.971192:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718346624 00000100:00100000:2.0:1788940512.971205:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718346624 00000100:00100000:2.0:1788940512.971294:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 192 00000100:00100000:2.0:1788940512.971308:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf581500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+28:11080:x1875839718346624:12345-192.168.202.14@tcp:36:bash.0 00010000:00010000:2.0:1788940512.971975:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b7ba lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940512.972018:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b7ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940512.972056:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b7ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788940512.972142:0:5862:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000004:00010000:2.0:1788940512.972176:0:5862:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d88a736c reply state 00000000a666c185 transno 4294967475 ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b7ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940512.972187:0:5862:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1788940512.972264:0:5862:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000100:00100000:2.0:1788940512.973084:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf581500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+32:11080:x1875839718346624:12345-192.168.202.14@tcp:36:bash.0 Request processed in 1771us (1992us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1788940512.973096:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 192 00000020:00080000:2.0:1788940512.973103:0:5862:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1788940512.976077:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940512.976279:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718346752 00000100:00100000:2.0:1788940512.976291:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718346752 00000100:00100000:2.0:1788940512.976359:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 193 00000100:00100000:2.0:1788940512.976370:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b48a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+32:11080:x1875839718346752:12345-192.168.202.14@tcp:101:bash.0 00010000:00010000:2.0:1788940512.976404:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940512.976434:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4b7c1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5a52 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940512.976543:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4b7c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a52 expref: 33 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940512.976562:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4b7c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a52 expref: 33 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940512.976587:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89f186946100) 00010000:00010000:2.0:1788940512.976608:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788940512.976613:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f188daa400, rc 0) 00000100:00100000:2.0:1788940512.976695:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b48a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+33:11080:x1875839718346752:12345-192.168.202.14@tcp:101:bash.0 Request processed in 314us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940512.976704:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 193 00000100:00100000:3.0:1788940512.979363:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940512.979552:0:7074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718346880 00000100:00100000:2.0:1788940512.979564:0:7074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718346880 00000100:00100000:2.0:1788940512.979626:0:7074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 58 00000100:00100000:2.0:1788940512.979637:0:7074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f192601850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+7:11080:x1875839718346880:12345-192.168.202.14@tcp:101:bash.0 00010000:00010000:2.0:1788940512.979660:0:7074:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940512.979756:0:7074:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000817c3d73/0x27a633fcdd4b7c8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5a59 expref: -99 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788940512.979793:0:7074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa110e0, atime: 0x6aa110de, ctime: 0x6aa110e0, blocks: 0xb 00010000:00010000:2.0:1788940512.979823:0:7074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=455s v=(0 0) 00010000:00010000:2.0:1788940512.979828:0:7074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940512.979838:0:7074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000817c3d73/0x27a633fcdd4b7c8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a59 expref: 8 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940512.979857:0:7074:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000817c3d73/0x27a633fcdd4b7c8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a59 expref: 8 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940512.979872:0:7074:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f188dab400, rc 0) 00000100:00100000:2.0:1788940512.979943:0:7074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f192601850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+8:11080:x1875839718346880:12345-192.168.202.14@tcp:101:bash.0 Request processed in 307us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940512.979951:0:7074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 58 00010000:00010000:1.0:1788940512.982344:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b7ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940512.982366:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b7ba lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940512.982375:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b7ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940512.982381:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188daa600 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940512.982386:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b7ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940512.982394:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b7ba lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940512.982414:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89f186946100) 00010000:00010000:1.0:1788940512.982418:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940512.982424:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b7ba lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940512.982429:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b7ba lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940512.983119:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940512.983214:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718347008 00000100:00100000:3.0:1788940512.983226:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718347008 00002000:00010000:3.0:1788940512.983290:0:6712:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:3.0:1788940512.983296:0:6712:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89f1bf97e680 with x1875839718347008 ext(0->18446744073709551615) 00002000:00010000:3.0:1788940512.983312:0:6712:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89f1bf97e680. 00000100:00100000:3.0:1788940512.983394:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 5 00000100:00100000:3.0:1788940512.983406:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf97e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+8:2351:x1875839718347008:12345-192.168.202.14@tcp:10:bash.0 00002000:00010000:3.0:1788940512.983998:0:6712:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788940512.984004:0:6712:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788940512 -> 1788940514 00002000:00010000:3.0:1788940512.984007:0:6712:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1788940510 -> 1788940510 00002000:00010000:3.0:1788940512.984010:0:6712:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788940512 -> 1788940514 00002000:00010000:3.0:1788940512.984029:0:6712:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1788940512.984109:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf97e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+9:2351:x1875839718347008:12345-192.168.202.14@tcp:10:bash.0 Request processed in 703us (995us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1788940512.984120:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 5 00002000:00010000:3.0:1788940512.984124:0:6712:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:3.0:1788940512.984127:0:6712:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89f1bf97e680 with x1875839718347008 ext(0->18446744073709551615) 00002000:00010000:3.0:1788940512.984133:0:6712:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89f1bf97e680. 00000100:00100000:2.0:1788940513.066706:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940513.066826:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718347136 00000100:00100000:0.0:1788940513.066838:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718347136 00000100:00100000:0.0:1788940513.066910:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 194 00000100:00100000:0.0:1788940513.066922:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5625500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+32:11560:x1875839718347136:12345-192.168.202.14@tcp:34:lfs.0 00010000:00010000:0.0:1788940513.067026:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b7cf lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.067051:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b7cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.067066:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b7cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.067085:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b7d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.067093:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b7d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.067101:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b7d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.067443:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4b7dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.067464:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4b7dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.067472:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4b7dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788940513.067580:0:7857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4b7dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.067593:0:7857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b7cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.067600:0:7857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b7cf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.067607:0:7857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b7cf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.067614:0:7857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad2000 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:0.0:1788940513.067619:0:7857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b7cf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.067628:0:7857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b7cf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.067640:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89f1983af600) 00010000:00010000:0.0:1788940513.067644:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940513.067649:0:7857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b7cf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.067657:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b7cf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.067688:0:7857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b7d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.067694:0:7857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b7d6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.067699:0:7857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b7d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.067704:0:7857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad3800 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:0.0:1788940513.067707:0:7857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b7d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.067713:0:7857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b7d6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.067720:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff89f1983afa00) 00010000:00010000:0.0:1788940513.067723:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940513.067726:0:7857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b7d6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.067732:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b7d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.067751:0:7857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4b7dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.067757:0:7857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4b7dd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.067763:0:7857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4b7dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.067774:0:7857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad2e00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:0.0:1788940513.067778:0:7857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4b7dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.067784:0:7857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4b7dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.067791:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89f186946100) 00010000:00010000:0.0:1788940513.067794:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940513.067798:0:7857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4b7dd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.067803:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4b7dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940513.067894:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5625500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+32:11560:x1875839718347136:12345-192.168.202.14@tcp:34:lfs.0 Request processed in 973us (1203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940513.067905:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 194 00000100:00100000:0.0:1788940513.107133:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940513.107336:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718347392 00000100:00100000:2.0:1788940513.107349:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718347392 00000100:00100000:2.0:1788940513.107425:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 195 00000100:00100000:2.0:1788940513.107437:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b48a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+32:11563:x1875839718347392:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:2.0:1788940513.107464:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940513.107493:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4b7e4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5a60 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.107679:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b7eb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.107696:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b7eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.107712:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b7eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.107729:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b7f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.107737:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b7f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.107744:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b7f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.108401:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4b7f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.108415:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4b7f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.108433:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4b7f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940513.108447:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788940513.109444:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b7eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.109458:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b7eb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.109466:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b7eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.109473:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188daa600 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940513.109479:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b7eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.109717:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b7eb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.109735:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89f1983af600) 00010000:00010000:2.0:1788940513.109739:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940513.109746:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b7eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.109752:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b7eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.109770:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b7f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.109776:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b7f2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.109795:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b7f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.109800:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188daac00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940513.109804:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b7f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.109810:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b7f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.109819:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff89f186946900) 00010000:00010000:2.0:1788940513.109822:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940513.109825:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b7f2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.109831:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b7f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.109903:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4b7e4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a60 expref: 35 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.109932:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4b7f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a60 expref: 34 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.109941:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89f186946100) 00010000:00010000:2.0:1788940513.109943:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788940513.109946:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f188dabe00, rc 0) 00000100:00100000:2.0:1788940513.110049:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b48a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+34:11563:x1875839718347392:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 2612us (2940us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1788940513.110069:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 195 00000100:00100000:1.0:1788940513.113344:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940513.113547:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718347520 00000100:00100000:0.0:1788940513.113559:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718347520 00000100:00100000:0.0:1788940513.113631:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 196 00000100:00100000:0.0:1788940513.113644:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+34:11563:x1875839718347520:12345-192.168.202.14@tcp:54:lfs.0 00010000:00010000:0.0:1788940513.113728:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b807 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.113747:0:7857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b7ac lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a4b expref: 34 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.113770:0:7857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b807 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.113811:0:7857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b7ac lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a4b expref: 34 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.113824:0:7857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b7ac lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a4b expref: 34 pid: 5860 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940513.113838:0:7857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b48a5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7857:1875839738267648:192.168.202.14@tcp:104: 00000100:00100000:0.0:1788940513.113946:0:7857:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f18dea0b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788940513.118020:0:7857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b48a5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7857:1875839738267648:192.168.202.14@tcp:104: 00010000:00010000:1.0:1788940513.118061:0:7857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b807 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940513.118110:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940513.120370:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718347776 00000100:00100000:1.0:1788940513.120691:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718347776 00000100:00100000:1.0:1788940513.120815:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 52 00000100:00100000:1.0:1788940513.120827:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf581f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+35:9966:x1875839718347776:12345-192.168.202.14@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788940513.121326:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf581f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+36:9966:x1875839718347776:12345-192.168.202.14@tcp:35:ldlm_bl.0 Request processed in 500us (3216us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1788940513.121335:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 52 00000100:00100000:0.0:1788940513.124394:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940513.124497:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718347904 00000100:00100000:2.0:1788940513.124510:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718347904 00010000:00010000:2.0:1788940513.124598:0:5845:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b7ac lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a4b expref: 36 pid: 5860 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940513.124647:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 75 00000100:00100000:2.0:1788940513.124656:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1841b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+36:2353:x1875839718347904:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788940513.124673:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940513.124680:0:5845:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b7ac lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a4b expref: 36 pid: 5860 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.124692:0:5845:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b7ac lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a4b expref: 36 pid: 5860 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.124714:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b7ac lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a4b expref: 36 pid: 5860 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.124729:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89f186946100) 00010000:00010000:2.0:1788940513.124734:0:5845:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b807 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.124746:0:5845:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b807 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.124755:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b807 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.124811:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940513.124874:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1841b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+35:2353:x1875839718347904:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 219us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940513.124881:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 75 00010000:00010000:0.0:1788940513.125435:0:7857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b807 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.125446:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b807 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.125487:0:7857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b807 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.125496:0:7857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b807 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.125503:0:7857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b807 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.125511:0:7857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad3800 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:0.0:1788940513.125542:0:7857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b807 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.125558:0:7857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b807 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.125574:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89f186946100) 00010000:00010000:0.0:1788940513.125576:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788940513.125580:0:7857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b807 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.125584:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b807 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940513.125635:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+34:11563:x1875839718347520:12345-192.168.202.14@tcp:54:lfs.0 Request processed in 11996us (12301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940513.125642:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 196 00000100:00100000:0.0:1788940513.130666:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940513.130858:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718348160 00000100:00100000:3.0:1788940513.130873:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718348160 00000100:00100000:3.0:1788940513.130947:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 53 00000100:00100000:3.0:1788940513.130960:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b48a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+34:11563:x1875839718348160:12345-192.168.202.14@tcp:35:lfs.0 00000100:00100000:3.0:1788940513.131746:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b48a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+35:11563:x1875839718348160:12345-192.168.202.14@tcp:35:lfs.0 Request processed in 786us (1094us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1788940513.131757:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 53 00000100:00100000:3.0:1788940513.242811:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940513.242915:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718348416 00000100:00100000:0.0:1788940513.242928:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718348416 00000100:00100000:0.0:1788940513.243012:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 197 00000100:00100000:0.0:1788940513.243025:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf581c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+35:11574:x1875839718348416:12345-192.168.202.14@tcp:101:cat.0 00010000:00010000:0.0:1788940513.243066:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940513.243097:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b80e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5a67 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.243434:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b815 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.243456:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b815 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.243638:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b815 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.243658:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b81c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.243667:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b81c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.243674:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b81c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.246286:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4b823 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.246315:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4b823 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.246327:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4b823 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940513.246342:0:5860:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:0.0:1788940513.246589:0:5860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b815 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.246598:0:5860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b815 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.246607:0:5860:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b815 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.246613:0:5860:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad2600 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:0.0:1788940513.246631:0:5860:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b815 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.246640:0:5860:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b815 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.246656:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89f1983af600) 00010000:00010000:0.0:1788940513.246659:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940513.246665:0:5860:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b815 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.246672:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b815 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.246803:0:5860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b81c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.246812:0:5860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b81c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.246818:0:5860:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b81c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.246823:0:5860:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad2000 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:0.0:1788940513.246826:0:5860:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b81c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.246833:0:5860:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b81c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.246843:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff89f1983afa00) 00010000:00010000:0.0:1788940513.246845:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940513.246856:0:5860:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b81c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.246864:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b81c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.247086:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b80e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a67 expref: 38 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.247109:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4b823 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a67 expref: 37 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.247117:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89f186946100) 00010000:00010000:0.0:1788940513.247120:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788940513.247122:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f082ad2e00, rc 0) 00000100:00100000:0.0:1788940513.247389:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf581c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+37:11574:x1875839718348416:12345-192.168.202.14@tcp:101:cat.0 Request processed in 4364us (4591us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1788940513.247401:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 197 00000100:00100000:2.0:1788940513.254382:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940513.254822:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718348672 00000100:00100000:3.0:1788940513.254837:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718348672 00000100:00100000:3.0:1788940513.255093:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 54 00000100:00100000:3.0:1788940513.255107:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5625880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+37:11574:x1875839718348672:12345-192.168.202.14@tcp:35:cat.0 00000100:00100000:3.0:1788940513.255491:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5625880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+38:11574:x1875839718348672:12345-192.168.202.14@tcp:35:cat.0 Request processed in 377us (1113us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1788940513.255500:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 54 00000100:00100000:2.0:1788940513.287204:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940513.287407:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718348928 00000100:00100000:1.0:1788940513.287421:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718348928 00000100:00100000:1.0:1788940513.287513:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 198 00000100:00100000:1.0:1788940513.287574:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5624000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+38:11575:x1875839718348928:12345-192.168.202.14@tcp:36:rm.0 00010000:00010000:1.0:1788940513.287668:0:5862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788940513.287721:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4b823 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a67 expref: 38 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940513.287760:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4b7f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a60 expref: 37 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940513.287776:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4b7c1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a52 expref: 36 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940513.287787:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89f186946100) 00010000:00010000:1.0:1788940513.287802:0:5862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788940513.287852:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258cc00/0x27a633fcdd4b831 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940513.287872:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258cc00/0x27a633fcdd4b831 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940513.287884:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258cc00/0x27a633fcdd4b831 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940513.288074:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4b838 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940513.288083:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4b838 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940513.288091:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4b838 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940513.288499:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4b83f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940513.288509:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4b83f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940513.288568:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4b83f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788940513.290863:0:5862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:2.0:1788940513.290887:0:5862:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 456189368214ns, next at 457189362531ns, rc = 0 00010000:00010000:2.0:1788940513.291205:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b846 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.291238:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b846 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.291256:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b846 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.291268:0:5862:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b846 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.291276:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b846 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.291284:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b846 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.291323:0:5862:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788940513.291357:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4b83f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.291364:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4b83f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.291384:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4b83f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.291391:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258d800 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940513.291397:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4b83f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.291408:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4b83f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.291425:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89f188f81200) 00010000:00010000:2.0:1788940513.291428:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788940513.291436:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4b83f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.291443:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4b83f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.291472:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258cc00/0x27a633fcdd4b831 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.291479:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258cc00/0x27a633fcdd4b831 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.291486:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258cc00/0x27a633fcdd4b831 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.291492:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258cc00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940513.291495:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258cc00/0x27a633fcdd4b831 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.291512:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258cc00/0x27a633fcdd4b831 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.291555:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89f1983af600) 00010000:00010000:2.0:1788940513.291558:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940513.291563:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258cc00/0x27a633fcdd4b831 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.291569:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258cc00/0x27a633fcdd4b831 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788940513.291582:0:5862:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002c9cf480 reply state 00000000dd64dbbe transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4b838 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940513.291594:0:5862:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788940513.291836:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940513.291845:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b846 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.291853:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188daaa00 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:0.0:1788940513.291856:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b846 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.291863:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b846 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.291873:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89f188f81200) 00010000:00010000:0.0:1788940513.291883:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788940513.291887:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b846 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.291892:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b846 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.291926:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940513.291928:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940513.291930:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940513.292245:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5624000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+37:11575:x1875839718348928:12345-192.168.202.14@tcp:36:rm.0 Request processed in 4657us (5042us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1788940513.292256:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 198 00010000:00010000:3.0:1788940513.303259:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4b838 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940513.303316:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4b838 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940513.303326:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4b838 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940513.303333:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258d000 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940513.303340:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4b838 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940513.303352:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4b838 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940513.303379:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff89f188f81b00) 00010000:00010000:3.0:1788940513.303383:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940513.303391:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4b838 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940513.303399:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4b838 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940513.370916:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940513.371147:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718349184 00000100:00100000:0.0:1788940513.371161:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718349184 00000100:00100000:0.0:1788940513.371246:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 199 00000100:00100000:0.0:1788940513.371260:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5625c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+36:11582:x1875839718349184:12345-192.168.202.14@tcp:101:bash.0 00010000:00010000:0.0:1788940513.371299:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940513.371331:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b84d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5a6e expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.371579:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b854 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.371604:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b854 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.371620:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b854 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.371639:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b85b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.371647:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b85b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.371675:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b85b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788940513.373320:0:5861:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1788940513.374888:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4b862 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.375050:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4b862 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.375070:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4b862 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.375242:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b854 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.375276:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b854 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.375285:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b854 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.375294:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad2000 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940513.375301:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b854 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.375313:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b854 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.375333:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89f1983af600) 00010000:00010000:2.0:1788940513.375338:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940513.375348:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b854 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.375356:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b854 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788940513.375386:0:5861:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000465744c8 reply state 000000001057284f transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b85b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940513.375401:0:5861:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788940513.375477:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b84d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a6e expref: 39 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.375692:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4b862 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a6e expref: 38 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.375714:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89f186946900) 00010000:00010000:2.0:1788940513.375718:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788940513.375721:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f188daba00, rc 0) 00000100:00100000:2.0:1788940513.375837:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5625c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+39:11582:x1875839718349184:12345-192.168.202.14@tcp:101:bash.0 Request processed in 4579us (4949us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1788940513.375847:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 199 00010000:00010000:1.0:1788940513.380486:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b85b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940513.380515:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b85b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940513.380565:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b85b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940513.380593:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad2600 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940513.380598:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b85b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940513.380607:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b85b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940513.380630:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff89f1983afa00) 00010000:00010000:1.0:1788940513.380633:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940513.380640:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b85b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940513.380647:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b85b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940513.381014:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940513.381689:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718349312 00000100:00100000:3.0:1788940513.381703:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718349312 00000100:00100000:3.0:1788940513.381769:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 59 00000100:00100000:3.0:1788940513.381780:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5624a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+5:2353:x1875839718349312:12345-192.168.202.14@tcp:101:bash.0 00010000:00010000:3.0:1788940513.381806:0:6707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940513.381831:0:6707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007cfb8755/0x27a633fcdd4b870 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5a75 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788940513.381884:0:6707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788940513.381925:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=456s v=(0 0) 00010000:00010000:3.0:1788940513.381932:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940513.381945:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007cfb8755/0x27a633fcdd4b870 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a75 expref: 6 pid: 6707 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940513.381969:0:6707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007cfb8755/0x27a633fcdd4b870 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a75 expref: 6 pid: 6707 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940513.381983:0:6707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f1bfa96a00, rc 0) 00000100:00100000:3.0:1788940513.382176:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5624a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2353:x1875839718349312:12345-192.168.202.14@tcp:101:bash.0 Request processed in 396us (1167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940513.382184:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 59 00000100:00100000:2.0:1788940513.385932:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940513.386282:0:12095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718349440 00000100:00100000:3.0:1788940513.386296:0:12095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718349440 00000100:00100000:3.0:1788940513.386369:0:12095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 60 00000100:00100000:3.0:1788940513.386382:0:12095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5627100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:11582:x1875839718349440:12345-192.168.202.14@tcp:101:bash.0 00010000:00010000:3.0:1788940513.386410:0:12095:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940513.386435:0:12095:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb0a027a/0x27a633fcdd4b877 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5a7c expref: -99 pid: 12095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940513.386486:0:12095:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007cfb8755/0x27a633fcdd4b870 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a75 expref: 7 pid: 6707 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940513.386498:0:12095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940513.386654:0:12095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940513.386662:0:12095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb0a027a/0x27a633fcdd4b877 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a7c expref: 7 pid: 12095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940513.386826:0:12095:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007cfb8755/0x27a633fcdd4b870 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a75 expref: 7 pid: 6707 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940513.386844:0:12095:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007cfb8755/0x27a633fcdd4b870 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a75 expref: 7 pid: 6707 timeout: 556 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940513.386862:0:12095:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf580a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12095:1875839738267776:192.168.202.14@tcp:104: 00000100:00100000:3.0:1788940513.387464:0:12095:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1b8bc1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788940513.390699:0:12095:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf580a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12095:1875839738267776:192.168.202.14@tcp:104: 00010000:00010000:3.0:1788940513.390747:0:12095:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000eb0a027a/0x27a633fcdd4b877 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a7c expref: 7 pid: 12095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940513.390775:0:12095:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f1bfa97e00, rc 0) 00000100:00100000:3.0:1788940513.390854:0:12095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5627100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9c51ff78-d02d-4e61-8a10-a2f8830f1679+7:11582:x1875839718349440:12345-192.168.202.14@tcp:101:bash.0 Request processed in 4474us (4938us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940513.390865:0:12095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 60 00000100:00100000:2.0:1788940513.394664:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940513.394856:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718349568 00000100:00100000:0.0:1788940513.394870:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718349568 00010000:00010000:0.0:1788940513.394945:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007cfb8755/0x27a633fcdd4b870 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a75 expref: 7 pid: 6707 timeout: 556 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940513.395006:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 76 00000100:00100000:0.0:1788940513.395017:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5627800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+7:2352:x1875839718349568:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940513.395038:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940513.395073:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007cfb8755/0x27a633fcdd4b870 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a75 expref: 7 pid: 6707 timeout: 556 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.395091:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007cfb8755/0x27a633fcdd4b870 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a75 expref: 7 pid: 6707 timeout: 556 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.395134:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007cfb8755/0x27a633fcdd4b870 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a75 expref: 7 pid: 6707 timeout: 556 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.395162:0:5846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940513.395168:0:5846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940513.395182:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eb0a027a/0x27a633fcdd4b877 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a7c expref: 6 pid: 12095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.395222:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb0a027a/0x27a633fcdd4b877 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a7c expref: 6 pid: 12095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.395292:0:5846:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000eb0a027a/0x27a633fcdd4b877 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a7c expref: 6 pid: 12095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940513.395311:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b48a5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5846:1875839738267904:192.168.202.14@tcp:105: 00000100:00100000:0.0:1788940513.395752:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f18dea0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788940513.403342:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940513.403447:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718349824 00000100:00100000:1.0:1788940513.403461:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718349824 00000100:00100000:1.0:1788940513.403612:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 55 00000100:00100000:1.0:1788940513.403624:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5627b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+38:11582:x1875839718349824:12345-192.168.202.14@tcp:35:bash.0 00000100:00100000:1.0:1788940513.404279:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5627b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+39:11582:x1875839718349824:12345-192.168.202.14@tcp:35:bash.0 Request processed in 654us (952us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1788940513.404290:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 55 00000100:00100000:0.0:1788940513.404390:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b48a5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5846:1875839738267904:192.168.202.14@tcp:105: 00010000:00010000:0.0:1788940513.404418:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940513.404448:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5627800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2352:x1875839718349568:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 9433us (9801us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940513.404458:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 76 00000100:00100000:1.0:1788940513.594103:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940513.595191:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718349952 00000100:00100000:0.0:1788940513.595208:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718349952 00000100:00100000:0.0:1788940513.595302:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 200 00000100:00100000:0.0:1788940513.595314:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b500fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+39:11598:x1875839718349952:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:0.0:1788940513.595349:0:7857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940513.595377:0:7857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b87e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5a83 expref: -99 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.595473:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b885 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.595509:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b885 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.595567:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b885 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940513.595616:0:7857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788940513.595621:0:7857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788940513.595646:0:7857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b885 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.595677:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b87e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a83 expref: 41 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.595701:0:7857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b885 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a83 expref: 40 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.595710:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89f1983af600) 00010000:00010000:0.0:1788940513.595713:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788940513.595718:0:7857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f082ad3800, rc 0) 00000100:00100000:0.0:1788940513.595811:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b500fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+40:11598:x1875839718349952:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 499us (1723us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940513.595818:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 200 00000100:00100000:2.0:1788940513.608820:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940513.608953:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718350208 00000100:00100000:0.0:1788940513.608966:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718350208 00000100:00100000:0.0:1788940513.609045:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 201 00000100:00100000:0.0:1788940513.609057:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5626d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+40:11598:x1875839718350208:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:0.0:1788940513.609091:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940513.609297:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b88c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5a8a expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.609481:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b893 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.609500:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b893 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.609781:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b893 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940513.609800:0:5860:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788940513.610157:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b88c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a8a expref: 43 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.610184:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b893 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a8a expref: 42 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.610193:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89f186946900) 00010000:00010000:0.0:1788940513.610197:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788940513.610201:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f082ad2000, rc 0) 00000100:00100000:0.0:1788940513.610305:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5626d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+42:11598:x1875839718350208:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 1249us (1501us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1788940513.610316:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 201 00000100:00100000:3.0:1788940513.620115:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940513.620172:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940513.620292:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718350592 00000100:00100000:2.0:1788940513.620308:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718350592 00000100:00100000:2.0:1788940513.620389:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 15 00000100:00100000:2.0:1788940513.620402:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf580a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+42:2353:x1875839718350592:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788940513.620425:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940513.620462:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b893 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a8a expref: 42 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.620500:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89f186946900) 00010000:00010000:2.0:1788940513.620507:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940513.620795:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf580a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+41:2353:x1875839718350592:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 395us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940513.620805:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 15 00000100:00100000:0.0:1788940513.621170:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718350464 00000100:00100000:0.0:1788940513.621179:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718350464 00000100:00100000:0.0:1788940513.621237:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 202 00000100:00100000:0.0:1788940513.621248:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf582300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+41:11598:x1875839718350464:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:0.0:1788940513.621282:0:7857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940513.621325:0:7857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b8a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5a91 expref: -99 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.621468:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b8a8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.621499:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b8a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.621514:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b8a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940513.621696:0:7857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788940513.621877:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b8a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a91 expref: 44 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.621976:0:7857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b8a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a91 expref: 43 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.621985:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89f186946900) 00010000:00010000:0.0:1788940513.621988:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788940513.621992:0:7857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f082ad2600, rc 0) 00000100:00100000:0.0:1788940513.622127:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf582300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+43:11598:x1875839718350464:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 880us (1952us total) trans 4294967486 rc 0/0 00000100:00100000:0.0:1788940513.622136:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 202 00000100:00100000:3.0:1788940513.634956:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940513.635290:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718350720 00000100:00100000:0.0:1788940513.635306:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718350720 00000100:00100000:0.0:1788940513.635387:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 61 00000100:00100000:0.0:1788940513.635400:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf580380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+6:2352:x1875839718350720:12345-192.168.202.14@tcp:1:lfs.0 00010000:00010000:0.0:1788940513.635485:0:6708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6f0c9bd/0x27a633fcdd4b8b6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.635512:0:6708:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000eb0a027a/0x27a633fcdd4b877 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a7c expref: 6 pid: 12095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.635721:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940513.635727:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788940513.635732:0:6708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6f0c9bd/0x27a633fcdd4b8b6 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.635790:0:6708:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000eb0a027a/0x27a633fcdd4b877 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a7c expref: 6 pid: 12095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.635807:0:6708:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000eb0a027a/0x27a633fcdd4b877 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a7c expref: 6 pid: 12095 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940513.635828:0:6708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b48a5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6708:1875839738268032:192.168.202.14@tcp:104: 00000100:00100000:0.0:1788940513.636155:0:6708:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f18dea0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788940513.643947:0:6708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b48a5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6708:1875839738268032:192.168.202.14@tcp:104: 00010000:00010000:0.0:1788940513.643986:0:6708:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d6f0c9bd/0x27a633fcdd4b8b6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940513.646383:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940513.647196:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718350848 00000100:00100000:0.0:1788940513.647212:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718350848 00002000:00100000:0.0:1788940513.647292:0:6711:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff89f1bf580700 x1875839718350848/t0(0) o4->9c51ff78-d02d-4e61-8a10-a2f8830f1679@192.168.202.14@tcp:489/0 lens 504/0 e 0 to 0 dl 1788940524 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788940513.647325:0:6711:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89f1bf580700 with x1875839718350848 ext(0->8) 00010000:00010000:0.0:1788940513.647338:0:6711:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000eb0a027a/0x27a633fcdd4b877 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a7c expref: 7 pid: 12095 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.647359:0:6711:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000eb0a027a/0x27a633fcdd4b877 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a7c expref: 7 pid: 12095 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788940513.647369:0:6711:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff89f1bf580700 00000100:00100000:0.0:1788940513.647588:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 3 00000100:00100000:0.0:1788940513.647602:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf580700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+7:2352:x1875839718350848:12345-192.168.202.14@tcp:4:lfs.0 00000100:00100000:0.0:1788940513.648332:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf580700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+9:2352:x1875839718350848:12345-192.168.202.14@tcp:4:lfs.0 Request processed in 729us (1959us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788940513.648344:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 3 00002000:00100000:0.0:1788940513.648354:0:6711:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff89f1bf580700 x1875839718350848/t4294967308(0) o4->9c51ff78-d02d-4e61-8a10-a2f8830f1679@192.168.202.14@tcp:489/0 lens 504/448 e 0 to 0 dl 1788940524 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788940513.648363:0:6711:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89f1bf580700 with x1875839718350848 ext(0->8) 00010000:00010000:0.0:1788940513.648372:0:6711:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000eb0a027a/0x27a633fcdd4b877 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a7c expref: 9 pid: 12095 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.648389:0:6711:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000eb0a027a/0x27a633fcdd4b877 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a7c expref: 9 pid: 12095 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788940513.648397:0:6711:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff89f1bf580700 00000100:00100000:1.0:1788940513.661511:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940513.661714:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718350976 00000100:00100000:3.0:1788940513.661729:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718350976 00010000:00010000:3.0:1788940513.661801:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000eb0a027a/0x27a633fcdd4b877 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a7c expref: 9 pid: 12095 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940513.661841:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 77 00000100:00100000:3.0:1788940513.661852:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b500f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+9:2351:x1875839718350976:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940513.661871:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788940513.661911:0:5847:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788940513.661915:0:5847:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788940514 00002000:00010000:3.0:1788940513.661918:0:5847:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788940514 00002000:00010000:3.0:1788940513.661921:0:5847:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788940514 00010000:00010000:3.0:1788940513.661929:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000eb0a027a/0x27a633fcdd4b877 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a7c expref: 9 pid: 12095 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940513.661947:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000eb0a027a/0x27a633fcdd4b877 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a7c expref: 9 pid: 12095 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940513.661978:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb0a027a/0x27a633fcdd4b877 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a7c expref: 9 pid: 12095 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940513.661999:0:5847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788940513.662004:0:5847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788940513.662012:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d6f0c9bd/0x27a633fcdd4b8b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940513.662024:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6f0c9bd/0x27a633fcdd4b8b6 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940513.662088:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940513.662170:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b500f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+8:2351:x1875839718350976:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 318us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940513.662179:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 77 00010000:00010000:2.0:1788940513.662815:0:6708:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d6f0c9bd/0x27a633fcdd4b8b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.662840:0:6708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6f0c9bd/0x27a633fcdd4b8b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.662879:0:6708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6f0c9bd/0x27a633fcdd4b8b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.662900:0:6708:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d6f0c9bd/0x27a633fcdd4b8b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.662909:0:6708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d6f0c9bd/0x27a633fcdd4b8b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.662917:0:6708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad2800 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:2.0:1788940513.662922:0:6708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6f0c9bd/0x27a633fcdd4b8b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.662932:0:6708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6f0c9bd/0x27a633fcdd4b8b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.662950:0:6708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d6f0c9bd/0x27a633fcdd4b8b6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.662958:0:6708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6f0c9bd/0x27a633fcdd4b8b6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940513.663046:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf580380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+7:2352:x1875839718350720:12345-192.168.202.14@tcp:1:lfs.0 Request processed in 27648us (28104us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940513.663057:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 61 00000100:00100000:1.0:1788940513.674496:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940513.674663:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718351232 00000100:00100000:3.0:1788940513.674676:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718351232 00000100:00100000:3.0:1788940513.674756:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 56 00000100:00100000:3.0:1788940513.674768:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b05cf850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+43:11598:x1875839718351232:12345-192.168.202.14@tcp:35:lfs.0 00000004:00010000:3.0:1788940513.674854:0:5863:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b8a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a91 expref: 43 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788940513.675264:0:5863:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:3.0:1788940513.675319:0:5863:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:3.0:1788940513.675795:0:5863:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00010000:00010000:3.0:1788940513.675871:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97e00/0x27a633fcdd4b8bd lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940513.675892:0:5863:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4b862 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a6e expref: 47 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940513.675903:0:5863:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97e00/0x27a633fcdd4b8bd lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940513.675951:0:5863:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4b862 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a6e expref: 47 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940513.675971:0:5863:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4b862 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a6e expref: 47 pid: 5861 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940513.675999:0:5863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf580000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5863:1875839738268160:192.168.202.14@tcp:104: 00000100:00100000:3.0:1788940513.676125:0:5863:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1b8bc1600 going to sleep for 11 seconds 00000100:00100000:0.0:1788940513.678689:0:5863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf580000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5863:1875839738268160:192.168.202.14@tcp:104: 00010000:00010000:0.0:1788940513.678743:0:5863:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97e00/0x27a633fcdd4b8bd lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940513.679301:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940513.679426:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718351360 00000100:00100000:2.0:1788940513.679437:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718351360 00010000:00010000:2.0:1788940513.679484:0:5845:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4b862 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a6e expref: 48 pid: 5861 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940513.679573:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 78 00000100:00100000:2.0:1788940513.679585:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f0821c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+48:2352:x1875839718351360:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788940513.679602:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940513.679610:0:5845:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4b862 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a6e expref: 48 pid: 5861 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.679626:0:5845:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4b862 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a6e expref: 48 pid: 5861 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.679653:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4b862 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a6e expref: 48 pid: 5861 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.679683:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89f186946900) 00010000:00010000:2.0:1788940513.679690:0:5845:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97e00/0x27a633fcdd4b8bd lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.679700:0:5845:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97e00/0x27a633fcdd4b8bd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.679724:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97e00/0x27a633fcdd4b8bd lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.679750:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940513.679832:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f0821c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+47:2352:x1875839718351360:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 249us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940513.679840:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 78 00010000:00010000:0.0:1788940513.680155:0:5863:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97e00/0x27a633fcdd4b8bd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.680166:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97e00/0x27a633fcdd4b8bd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788940513.680377:0:5863:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:1.0:1788940513.684243:0:5863:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:1.0:1788940513.687345:0:5863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5863:1875839738268288:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788940513.687476:0:5863:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940513.687540:0:5863:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f187966f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788940513.687724:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738268288 00000100:00100000:2.0:1788940513.687734:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738268288 00000100:00100000:2.0:1788940513.687795:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788940513.687806:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f0821c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5863:x1875839738268288:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788940513.687899:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f0821c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5863:x1875839738268288:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 94us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940513.687906:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788940513.688666:0:5863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5863:1875839738268288:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788940513.690194:0:5863:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:3.0:1788940513.690334:0:5863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf580000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5863:1875839738268416:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788940513.690446:0:5863:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940513.690489:0:5863:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f187966cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940513.691478:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738268416 00000100:00100000:2.0:1788940513.691496:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738268416 00000100:00100000:2.0:1788940513.691603:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788940513.691614:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5863:x1875839738268416:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788940513.692232:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5863:x1875839738268416:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 607us (1774us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788940513.692241:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788940513.692721:0:5863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf580000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5863:1875839738268416:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788940513.692840:0:5863:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:3.0:1788940513.692916:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97e00/0x27a633fcdd4b8bd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940513.692931:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97e00/0x27a633fcdd4b8bd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940513.692942:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97e00/0x27a633fcdd4b8bd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940513.692950:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1bfa97e00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940513.693152:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97e00/0x27a633fcdd4b8bd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940513.693164:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97e00/0x27a633fcdd4b8bd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940513.693185:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89f186946900) 00010000:00010000:3.0:1788940513.693189:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788940513.693214:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97e00/0x27a633fcdd4b8bd lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940513.693232:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97e00/0x27a633fcdd4b8bd lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788940513.698408:0:5863:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788940513.698590:0:5863:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:3.0:1788940513.698607:0:5863:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 456597087806ns, next at 457597083543ns, rc = 0 00000001:00080000:3.0:1788940513.698619:0:5863:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:3.0:1788940513.698700:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89f186946900) 00010000:00010000:3.0:1788940513.698706:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788940513.698721:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b8a8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a91 expref: 51 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940513.698906:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b05cf850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+50:11598:x1875839718351232:12345-192.168.202.14@tcp:35:lfs.0 Request processed in 24139us (24426us total) trans 4294967495 rc 0/0 00000100:00100000:3.0:1788940513.698918:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 56 00000020:00080000:3.0:1788940513.698925:0:5863:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788940513.705673:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940513.705882:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718351488 00000100:00100000:2.0:1788940513.705906:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718351488 00000100:00100000:2.0:1788940513.705991:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 203 00000100:00100000:2.0:1788940513.706003:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f0821c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+50:11598:x1875839718351488:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:2.0:1788940513.706038:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940513.706085:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b8c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5a98 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.706169:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b8c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a98 expref: 51 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.706186:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b8c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a98 expref: 51 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.706211:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89f186946600) 00010000:00010000:2.0:1788940513.706215:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788940513.706219:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f188daac00, rc 0) 00000100:00100000:2.0:1788940513.706308:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f0821c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+51:11598:x1875839718351488:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 306us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940513.706315:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 203 00000100:00100000:1.0:1788940513.711040:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940513.711915:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718351744 00000100:00100000:2.0:1788940513.711931:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718351744 00000100:00100000:2.0:1788940513.712011:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 57 00000100:00100000:2.0:1788940513.712023:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfae8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+51:11598:x1875839718351744:12345-192.168.202.14@tcp:35:lfs.0 00000100:00100000:2.0:1788940513.712380:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfae8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+52:11598:x1875839718351744:12345-192.168.202.14@tcp:35:lfs.0 Request processed in 356us (1353us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1788940513.712388:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 57 00000100:00100000:3.0:1788940513.816396:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940513.816614:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718351872 00000100:00100000:0.0:1788940513.816626:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718351872 00000100:00100000:0.0:1788940513.816717:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 204 00000100:00100000:0.0:1788940513.816729:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+52:11608:x1875839718351872:12345-192.168.202.14@tcp:34:lfs.0 00010000:00010000:0.0:1788940513.816851:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4b8cb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.816876:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4b8cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.817097:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4b8cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.817120:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3400/0x27a633fcdd4b8d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.817129:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3400/0x27a633fcdd4b8d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.817137:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3400/0x27a633fcdd4b8d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.817289:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b8d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.817297:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b8d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.817304:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b8d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788940513.817357:0:7857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b8d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.817372:0:7857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4b8cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.817379:0:7857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4b8cb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.817387:0:7857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4b8cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.817394:0:7857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad2e00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:0.0:1788940513.817399:0:7857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4b8cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.817408:0:7857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4b8cb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.817421:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89f1983af600) 00010000:00010000:0.0:1788940513.817425:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940513.817433:0:7857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4b8cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.817448:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4b8cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.817468:0:7857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3400/0x27a633fcdd4b8d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.817474:0:7857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3400/0x27a633fcdd4b8d2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.817479:0:7857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3400/0x27a633fcdd4b8d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.817496:0:7857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad3400 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:0.0:1788940513.817499:0:7857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3400/0x27a633fcdd4b8d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.817505:0:7857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3400/0x27a633fcdd4b8d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.817513:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff89f1983afc00) 00010000:00010000:0.0:1788940513.817579:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940513.817584:0:7857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3400/0x27a633fcdd4b8d2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.817590:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3400/0x27a633fcdd4b8d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.817610:0:7857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b8d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.817617:0:7857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b8d9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.817630:0:7857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b8d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.817635:0:7857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad2600 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:0.0:1788940513.817638:0:7857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b8d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.817645:0:7857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b8d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.817653:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89f186946600) 00010000:00010000:0.0:1788940513.817656:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940513.817659:0:7857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b8d9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.817666:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b8d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940513.818185:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+52:11608:x1875839718351872:12345-192.168.202.14@tcp:34:lfs.0 Request processed in 1453us (1799us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940513.818198:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 204 00000100:00100000:1.0:1788940513.856197:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940513.856329:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718352128 00000100:00100000:2.0:1788940513.856344:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718352128 00000100:00100000:2.0:1788940513.856426:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 205 00000100:00100000:2.0:1788940513.856440:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfae8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+52:11611:x1875839718352128:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:2.0:1788940513.856476:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940513.856622:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4b8e0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5a9f expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.856742:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4b8e7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.856763:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4b8e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.856788:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4b8e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.856806:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b8ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.856815:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b8ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.856821:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b8ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.857123:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4b8f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.857133:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4b8f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.857142:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4b8f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940513.857155:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788940513.857319:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4b8e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.857341:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4b8e7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.857349:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4b8e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.857357:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188daba00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940513.857363:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4b8e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.857372:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4b8e7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.857386:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89f1983af600) 00010000:00010000:2.0:1788940513.857390:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940513.857395:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4b8e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.857402:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4b8e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.857420:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b8ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.857427:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b8ee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.857433:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b8ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.857438:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188daa600 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940513.857447:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b8ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.857454:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b8ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.857461:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff89f186946a00) 00010000:00010000:2.0:1788940513.857464:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940513.857467:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b8ee lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.857473:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b8ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.857579:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4b8e0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a9f expref: 55 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.857597:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4b8f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a9f expref: 54 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.857605:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89f186946600) 00010000:00010000:2.0:1788940513.857608:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788940513.857611:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f188dabe00, rc 0) 00000100:00100000:2.0:1788940513.857693:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfae8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+54:11611:x1875839718352128:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 1256us (1514us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1788940513.857703:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 205 00000100:00100000:1.0:1788940513.863597:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940513.863780:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718352256 00000100:00100000:0.0:1788940513.863792:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718352256 00000100:00100000:0.0:1788940513.863861:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 206 00000100:00100000:0.0:1788940513.863872:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfae8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+54:11611:x1875839718352256:12345-192.168.202.14@tcp:54:lfs.0 00010000:00010000:0.0:1788940513.863974:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b903 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.864004:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b903 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.864036:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b903 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.864071:0:7857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b903 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.864078:0:7857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b903 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.864087:0:7857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b903 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.864093:0:7857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad2600 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:0.0:1788940513.864098:0:7857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b903 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.864107:0:7857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b903 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.864121:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89f186946600) 00010000:00010000:0.0:1788940513.864125:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788940513.864132:0:7857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b903 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.864139:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4b903 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940513.864235:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfae8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+54:11611:x1875839718352256:12345-192.168.202.14@tcp:54:lfs.0 Request processed in 364us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940513.864242:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 206 00000100:00100000:3.0:1788940513.870824:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940513.871005:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718352512 00000100:00100000:2.0:1788940513.871017:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718352512 00000100:00100000:2.0:1788940513.871080:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 58 00000100:00100000:2.0:1788940513.871091:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+54:11611:x1875839718352512:12345-192.168.202.14@tcp:35:lfs.0 00000100:00100000:2.0:1788940513.871441:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+55:11611:x1875839718352512:12345-192.168.202.14@tcp:35:lfs.0 Request processed in 351us (630us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1788940513.871451:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 58 00000100:00100000:1.0:1788940513.945748:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940513.945872:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718352768 00000100:00100000:2.0:1788940513.945884:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718352768 00000100:00100000:2.0:1788940513.946122:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 207 00000100:00100000:2.0:1788940513.946135:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae7c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+55:11621:x1875839718352768:12345-192.168.202.14@tcp:101:bash.0 00010000:00010000:2.0:1788940513.946171:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940513.946175:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788940513.946210:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4b885 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a83 expref: 55 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.946247:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89f1983af600) 00010000:00010000:2.0:1788940513.946254:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788940513.946272:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4b90a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5aa6 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.946404:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b911 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.946422:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4b8f5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a9f expref: 55 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.946433:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b911 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.946477:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4b8f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a9f expref: 55 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.946666:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4b8f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a9f expref: 55 pid: 5861 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940513.946683:0:5861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5626a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5861:1875839738268544:192.168.202.14@tcp:104: 00000100:00100000:2.0:1788940513.946815:0:5861:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1a1490e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788940513.952194:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940513.952331:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718352896 00000100:00100000:3.0:1788940513.952343:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718352896 00000100:00100000:2.0:1788940513.952368:0:5861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5626a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5861:1875839738268544:192.168.202.14@tcp:104: 00010000:00010000:3.0:1788940513.952397:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4b8f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a9f expref: 56 pid: 5861 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.952405:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b911 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940513.952446:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 79 00000100:00100000:3.0:1788940513.952458:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae7caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+56:2352:x1875839718352896:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940513.952475:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940513.952501:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4b8f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a9f expref: 56 pid: 5861 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940513.952543:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4b8f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a9f expref: 56 pid: 5861 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940513.952583:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4b8f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a9f expref: 56 pid: 5861 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940513.952604:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89f186946600) 00010000:00010000:3.0:1788940513.952609:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b911 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940513.952620:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b911 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940513.952629:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b911 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940513.952665:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788940513.952765:0:5861:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b911 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.952774:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b911 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940513.952799:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788940513.953015:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4b90a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5aa6 expref: 57 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.953036:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b911 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5aa6 expref: 56 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.953045:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89f186946600) 00010000:00010000:2.0:1788940513.953048:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788940513.953051:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f188daa600, rc 0) 00000100:00100000:2.0:1788940513.953130:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae7c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+56:11621:x1875839718352768:12345-192.168.202.14@tcp:101:bash.0 Request processed in 6997us (7397us total) trans 4294967499 rc 0/0 00000100:00100000:2.0:1788940513.953151:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 207 00000100:00100000:3.0:1788940513.953369:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae7caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+55:2352:x1875839718352896:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 912us (1189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940513.953379:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 79 00000100:00100000:3.0:1788940513.959113:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940513.959411:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718353152 00000100:00100000:0.0:1788940513.959442:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718353152 00000100:00100000:0.0:1788940513.959565:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 208 00000100:00100000:0.0:1788940513.959579:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+55:11621:x1875839718353152:12345-192.168.202.14@tcp:36:bash.0 00010000:00010000:0.0:1788940513.960913:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3400/0x27a633fcdd4b91f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.960944:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3400/0x27a633fcdd4b91f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940513.960960:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3400/0x27a633fcdd4b91f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788940513.961027:0:7857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967500 00000004:00010000:0.0:1788940513.961057:0:7857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005943b576 reply state 00000000a9ed842d transno 4294967501 ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3400/0x27a633fcdd4b91f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940513.961067:0:7857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788940513.961398:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+58:11621:x1875839718353152:12345-192.168.202.14@tcp:36:bash.0 Request processed in 1817us (2296us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1788940513.961410:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 208 00000020:00080000:0.0:1788940513.961417:0:7857:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788940513.965292:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940513.984244:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00010000:00010000:1.0:1788940513.984424:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3400/0x27a633fcdd4b91f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940513.984443:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3400/0x27a633fcdd4b91f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940513.984451:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3400/0x27a633fcdd4b91f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940513.984459:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad3400 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940513.984465:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3400/0x27a633fcdd4b91f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940513.984474:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3400/0x27a633fcdd4b91f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940513.984494:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89f186946600) 00010000:00010000:1.0:1788940513.984498:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940513.984504:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3400/0x27a633fcdd4b91f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940513.984512:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3400/0x27a633fcdd4b91f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940513.984892:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718353280 00000100:00100000:2.0:1788940513.984908:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718353280 00000100:00100000:2.0:1788940513.984984:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 209 00000100:00100000:2.0:1788940513.984995:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b48a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+57:11621:x1875839718353280:12345-192.168.202.14@tcp:101:bash.0 00010000:00010000:2.0:1788940513.985027:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940513.985048:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4b926 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5aad expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.985155:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4b92d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.985173:0:5860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b911 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5aa6 expref: 58 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.985184:0:5860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4b92d lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.985240:0:5860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b911 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5aa6 expref: 58 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940513.985256:0:5860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b911 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5aa6 expref: 58 pid: 5861 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940513.985275:0:5860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5626a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5860:1875839738268672:192.168.202.14@tcp:104: 00000100:00100000:2.0:1788940513.985578:0:5860:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1a95c89c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788940514.002239:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940514.003782:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718353408 00000100:00100000:3.0:1788940514.003801:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718353408 00010000:00010000:3.0:1788940514.003897:0:5845:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b911 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5aa6 expref: 59 pid: 5861 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940514.003963:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 80 00000100:00100000:3.0:1788940514.003997:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae7cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+59:2353:x1875839718353408:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940514.004017:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940514.004026:0:5845:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b911 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5aa6 expref: 59 pid: 5861 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940514.004042:0:5845:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b911 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5aa6 expref: 59 pid: 5861 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940514.004071:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89f186946600) 00010000:00010000:3.0:1788940514.004078:0:5845:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4b92d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940514.004090:0:5845:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4b92d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940514.004099:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4b92d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940514.004124:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940514.004198:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae7cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+59:2353:x1875839718353408:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 206us (1985us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940514.004205:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 80 00000100:00080000:0.0:1788940514.005510:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788940514.006179:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b911 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5aa6 expref: 58 pid: 5861 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940514.006233:0:5860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5626a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5860:1875839738268672:192.168.202.14@tcp:104: 00010000:00010000:2.0:1788940514.006267:0:5860:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4b92d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.006277:0:5860:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4b92d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.006284:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4b92d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940514.006375:0:5860:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788940514.006382:0:5860:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788940514.006415:0:5860:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4b92d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.006464:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4b926 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5aad expref: 58 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.006483:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4b92d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5aad expref: 57 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.006493:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89f186946600) 00010000:00010000:2.0:1788940514.006496:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788940514.006500:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f188daba00, rc 0) 00000100:00100000:2.0:1788940514.006642:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b48a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+57:11621:x1875839718353280:12345-192.168.202.14@tcp:101:bash.0 Request processed in 21647us (22424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940514.006651:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 209 00000100:00100000:1.0:1788940514.016942:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940514.017722:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718353664 00000100:00100000:2.0:1788940514.017760:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718353664 00000100:00100000:2.0:1788940514.017847:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 59 00000100:00100000:2.0:1788940514.017859:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b8bf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+57:11621:x1875839718353664:12345-192.168.202.14@tcp:35:bash.0 00000100:00100000:2.0:1788940514.018339:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b8bf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+58:11621:x1875839718353664:12345-192.168.202.14@tcp:35:bash.0 Request processed in 479us (1408us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1788940514.018350:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 59 00000100:00100000:3.0:1788940514.096790:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940514.097185:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718353792 00000100:00100000:2.0:1788940514.097199:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718353792 00000100:00100000:2.0:1788940514.097288:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 210 00000100:00100000:2.0:1788940514.097309:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+58:11627:x1875839718353792:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:2.0:1788940514.097346:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940514.097378:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4b934 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5ab4 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.097891:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b93b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.097915:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b93b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.097933:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b93b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940514.098993:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788940514.099002:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788940514.099040:0:5862:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b93b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940514.099092:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4b934 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5ab4 expref: 60 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940514.099164:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b93b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5ab4 expref: 59 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940514.099175:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89f1983af600) 00010000:00010000:3.0:1788940514.099179:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788940514.099183:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f188daa600, rc 0) 00000100:00100000:3.0:1788940514.099421:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+59:11627:x1875839718353792:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 2119us (2644us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940514.099431:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 210 00000100:00100000:0.0:1788940514.106884:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940514.107103:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718353920 00000100:00100000:2.0:1788940514.107165:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718353920 00000100:00100000:2.0:1788940514.107249:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 211 00000100:00100000:2.0:1788940514.107261:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b48a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+59:11627:x1875839718353920:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:2.0:1788940514.107289:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940514.107399:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4b942 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5abb expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.108165:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b949 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.108189:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b949 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.108209:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b949 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.108241:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4b950 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.108250:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4b950 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.108258:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4b950 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.108465:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4b957 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.108475:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4b957 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.108483:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4b957 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940514.108566:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788940514.108571:0:5861:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788940514.108597:0:5861:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4b957 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.108624:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4b957 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.108633:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b949 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.108640:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b949 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.108648:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b949 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.108655:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188daaa00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940514.108660:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b949 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.108669:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b949 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.108790:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89f1983af600) 00010000:00010000:2.0:1788940514.108794:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940514.108801:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b949 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.108808:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b949 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.108823:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4b950 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.108829:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4b950 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.108849:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4b950 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.108855:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188dab600 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940514.108858:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4b950 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.108865:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4b950 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.108873:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff89f186946a00) 00010000:00010000:2.0:1788940514.108876:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940514.108879:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4b950 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.108884:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4b950 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.109284:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4b942 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5abb expref: 61 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.109440:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4b957 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5abb expref: 60 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.109451:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89f186946600) 00010000:00010000:2.0:1788940514.109454:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788940514.109457:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f188dab800, rc 0) 00000100:00100000:2.0:1788940514.109590:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b48a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+60:11627:x1875839718353920:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 2330us (2725us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940514.109613:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 211 00000100:00100000:1.0:1788940514.117869:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940514.118142:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718354176 00000100:00100000:0.0:1788940514.118156:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718354176 00000100:00100000:0.0:1788940514.118248:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 212 00000100:00100000:0.0:1788940514.118261:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b8bf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+60:11627:x1875839718354176:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:0.0:1788940514.118289:0:7857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940514.118349:0:7857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b95e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5ac2 expref: -99 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940514.118494:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b965 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940514.118513:0:7857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4b92d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5aad expref: 61 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940514.118825:0:7857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4b957 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5abb expref: 61 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940514.118835:0:7857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b965 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940514.118892:0:7857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4b957 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5abb expref: 61 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940514.119035:0:7857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4b957 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5abb expref: 61 pid: 5861 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940514.119058:0:7857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b48a5180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7857:1875839738268800:192.168.202.14@tcp:104: 00010000:00010000:0.0:1788940514.119194:0:7857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4b92d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5aad expref: 61 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940514.119204:0:7857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4b92d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5aad expref: 61 pid: 5860 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940514.119214:0:7857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198183b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7857:1875839738268928:192.168.202.14@tcp:104: 00000100:00100000:0.0:1788940514.119264:0:7857:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f18dea0000 going to sleep for 11 seconds 00010000:00010000:0.0:1788940514.124630:0:7857:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.14@tcp) returned -22 from blocking AST (req@00000000ea9a2aef x1875839738268800) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4b957 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5abb expref: 61 pid: 5861 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940514.124663:0:7857:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4b957 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5abb expref: 61 pid: 5861 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940514.124880:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab800/0x27a633fcdd4b957 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5abb expref: 61 pid: 5861 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940514.124902:0:7857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b48a5180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7857:1875839738268800:192.168.202.14@tcp:104: 00000100:00100000:0.0:1788940514.124929:0:7857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198183b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7857:1875839738268928:192.168.202.14@tcp:104: 00010000:00010000:0.0:1788940514.124958:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89f186946600) 00010000:00010000:0.0:1788940514.124965:0:7857:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b965 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940514.124975:0:7857:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b965 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940514.124994:0:7857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b965 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940514.125858:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940514.126159:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718354432 00000100:00100000:0.0:1788940514.126167:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718354432 00010000:00010000:0.0:1788940514.126212:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4b92d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5aad expref: 61 pid: 5860 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940514.126268:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 81 00000100:00100000:0.0:1788940514.126307:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1923c7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+61:2352:x1875839718354432:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940514.126326:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940514.126334:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4b92d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5aad expref: 61 pid: 5860 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940514.126346:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4b92d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5aad expref: 61 pid: 5860 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940514.126366:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daba00/0x27a633fcdd4b92d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5aad expref: 61 pid: 5860 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940514.126382:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89f186946600) 00010000:00010000:0.0:1788940514.126387:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b965 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940514.126396:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b965 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940514.126404:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b965 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940514.127196:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940514.127323:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1923c7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+60:2352:x1875839718354432:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 1022us (1464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940514.127336:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 81 00000100:00100000:3.0:1788940514.132339:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940514.132873:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718354304 00000100:00100000:0.0:1788940514.132889:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718354304 00000100:00100000:0.0:1788940514.132985:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 16 00000100:00100000:0.0:1788940514.132998:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c6d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+60:2353:x1875839718354304:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940514.133038:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940514.133041:0:5845:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 27a633fcdd4b957) 00010000:00010000:0.0:1788940514.133043:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940514.133123:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c6d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+60:2353:x1875839718354304:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 123us (794us total) trans 0 rc 116/116 00000100:00100000:0.0:1788940514.133131:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 16 00010000:00010000:2.0:1788940514.135853:0:7857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b965 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.135876:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b965 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940514.136040:0:7857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788940514.136294:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4b95e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5ac2 expref: 61 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.136388:0:7857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b965 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5ac2 expref: 60 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.136399:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89f186946600) 00010000:00010000:2.0:1788940514.136402:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788940514.136406:0:7857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f082ad2800, rc 0) 00000100:00100000:2.0:1788940514.136788:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b8bf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+60:11627:x1875839718354176:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 18528us (18933us total) trans 4294967503 rc 0/0 00000100:00100000:2.0:1788940514.136800:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 212 00000100:00100000:0.0:1788940514.151107:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940514.154278:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718354688 00000100:00100000:2.0:1788940514.154313:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718354688 00000100:00100000:2.0:1788940514.154432:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 17 00000100:00100000:2.0:1788940514.154446:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f198183b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+60:11627:x1875839718354688:12345-192.168.202.14@tcp:103:lfs.0 00010000:00010000:2.0:1788940514.154468:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940514.154510:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b8c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a98 expref: 60 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.154852:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89f186946600) 00010000:00010000:2.0:1788940514.154860:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940514.154959:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f198183b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+59:11627:x1875839718354688:12345-192.168.202.14@tcp:103:lfs.0 Request processed in 515us (4051us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940514.154968:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 17 00000100:00100000:3.0:1788940514.159168:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940514.159475:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718354816 00000100:00100000:2.0:1788940514.159490:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718354816 00000100:00100000:2.0:1788940514.159594:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 213 00000100:00100000:2.0:1788940514.159607:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf580a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+59:11627:x1875839718354816:12345-192.168.202.14@tcp:58:lfs.0 00010000:00010000:2.0:1788940514.159803:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4b973 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.159830:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4b973 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.159847:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4b973 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788940514.161279:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1788940514.162316:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf580a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+59:11627:x1875839718354816:12345-192.168.202.14@tcp:58:lfs.0 Request processed in 2692us (3146us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940514.162336:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 213 00000100:00100000:1.0:1788940514.185663:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940514.185851:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718354944 00000100:00100000:3.0:1788940514.185864:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718354944 00000100:00100000:3.0:1788940514.185943:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 214 00000100:00100000:3.0:1788940514.185954:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf69d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+59:11627:x1875839718354944:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:3.0:1788940514.185993:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940514.186020:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97e00/0x27a633fcdd4b97a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5ac9 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940514.186100:0:5862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4b973 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940514.186478:0:5862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97e00/0x27a633fcdd4b97a lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5ac9 expref: 60 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940514.186508:0:5862:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4b973 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940514.186635:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97e00/0x27a633fcdd4b97a lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5ac9 expref: 60 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940514.186654:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89f186946600) 00010000:00010000:3.0:1788940514.186657:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788940514.186661:0:5862:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97e00/0x27a633fcdd4b97a lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5ac9 expref: 60 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940514.186739:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f1bfa97e00, rc 0) 00000100:00100000:3.0:1788940514.186818:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf69d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+60:11627:x1875839718354944:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 865us (1171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940514.186826:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 214 00000100:00100000:2.0:1788940514.284791:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf69c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738269056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788940514.284900:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940514.285061:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738269056 00000100:00100000:3.0:1788940514.285073:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738269056 00000100:00100000:3.0:1788940514.285158:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788940514.285169:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5626a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1875839738269056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788940514.285199:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788940514.285316:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788940514.295878:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5626a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1875839738269056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 10695us (10963us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940514.295899:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788940514.296366:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf69c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738269056:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1788940514.540927:0:11708:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788940514.540942:0:11708:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788940514.541016:0:11708:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1788940514.541028:0:11708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788940514.542896:0:11708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198181880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11708:1875839738269184:192.168.202.14@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788940514.544984:0:11708:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f18dea0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788940514.560930:0:11708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198181880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11708:1875839738269184:192.168.202.14@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788940514.568354:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940514.569372:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718355072 00000100:00100000:0.0:1788940514.569390:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718355072 00000100:00100000:0.0:1788940514.569463:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 215 00000100:00100000:0.0:1788940514.569473:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf69d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+60:11628:x1875839718355072:12345-192.168.202.14@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788940514.569511:0:5861:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788940514.569898:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf69d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+60:11628:x1875839718355072:12345-192.168.202.14@tcp:53:lhsmtool_posix.0 Request processed in 423us (1556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940514.569908:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 215 00000100:00100000:1.0:1788940514.575612:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940514.576726:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718355200 00000100:00100000:2.0:1788940514.576763:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718355200 00000100:00100000:2.0:1788940514.576852:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 216 00000100:00100000:2.0:1788940514.576866:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf69c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+60:11628:x1875839718355200:12345-192.168.202.14@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788940514.576970:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b981 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.577004:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b981 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.577021:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b981 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.577039:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4b988 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.577046:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4b988 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.577052:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4b988 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.577086:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b98f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.577097:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b98f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.577104:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b98f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940514.577170:0:7857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788940514.577176:0:7857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788940514.577201:0:7857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b98f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.577229:0:7857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b981 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.577237:0:7857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b981 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.577246:0:7857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b981 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.577253:0:7857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188daac00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940514.577257:0:7857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b981 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.577267:0:7857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b981 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.577281:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89f186946200) 00010000:00010000:2.0:1788940514.577285:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940514.577291:0:7857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b981 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.577297:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b981 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.577314:0:7857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4b988 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.577320:0:7857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4b988 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.577327:0:7857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4b988 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.577341:0:7857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188dab600 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940514.577344:0:7857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4b988 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.577349:0:7857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4b988 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.577357:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff89f186946a00) 00010000:00010000:2.0:1788940514.577359:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940514.577362:0:7857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4b988 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.577367:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4b988 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.577384:0:7857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b98f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.577391:0:7857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b98f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.577397:0:7857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b98f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.577402:0:7857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188daaa00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940514.577405:0:7857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b98f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.577411:0:7857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b98f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.577430:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89f186946600) 00010000:00010000:2.0:1788940514.577433:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940514.577436:0:7857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b98f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.577442:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b98f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940514.577581:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf69c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+60:11628:x1875839718355200:12345-192.168.202.14@tcp:34:lhsmtool_posix.0 Request processed in 718us (1983us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940514.577590:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 216 00000100:00100000:3.0:1788940514.585183:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940514.585875:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718355456 00000100:00100000:2.0:1788940514.585893:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718355456 00000100:00100000:2.0:1788940514.585999:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 217 00000100:00100000:2.0:1788940514.586020:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf583b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+60:11628:x1875839718355456:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788940514.586052:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940514.586084:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b996 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5ad0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.586257:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4b99d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.586290:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4b99d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.586306:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4b99d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940514.586321:0:5860:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788940514.586475:0:5860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4b99d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.586499:0:5860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4b99d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.586508:0:5860:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4b99d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.587755:0:5860:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188dab600 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940514.587774:0:5860:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4b99d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.587788:0:5860:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4b99d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.587805:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89f186946600) 00010000:00010000:2.0:1788940514.587809:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788940514.587816:0:5860:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4b99d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.587824:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4b99d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.587905:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b996 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5ad0 expref: 62 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.587917:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89f186946200) 00010000:00010000:2.0:1788940514.587920:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788940514.587924:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4b996 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5ad0 expref: 62 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.587960:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f188daaa00, rc 0) 00000100:00100000:2.0:1788940514.588431:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf583b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+61:11628:x1875839718355456:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 2409us (3259us total) trans 4294967504 rc 301/301 00000100:00100000:2.0:1788940514.588442:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 217 00000100:00100000:1.0:1788940514.594572:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940514.595159:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718355584 00000100:00100000:3.0:1788940514.595172:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718355584 00000100:00100000:3.0:1788940514.595279:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 218 00000100:00100000:3.0:1788940514.595291:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1841d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+61:11628:x1875839718355584:12345-192.168.202.14@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788940514.595362:0:5862:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788940514.595550:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1841d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+61:11628:x1875839718355584:12345-192.168.202.14@tcp:53:lhsmtool_posix.0 Request processed in 260us (1031us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940514.595559:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 218 00000100:00100000:1.0:1788940514.602204:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940514.602498:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718355840 00000100:00100000:2.0:1788940514.602511:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718355840 00000100:00100000:2.0:1788940514.602623:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 219 00000100:00100000:2.0:1788940514.602636:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1841d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+61:11628:x1875839718355840:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788940514.602664:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940514.602673:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788940514.602709:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b93b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5ab4 expref: 61 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.602734:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89f1983af600) 00010000:00010000:2.0:1788940514.602740:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788940514.602758:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b9ab lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5ad7 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788940514.603410:0:5861:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:2.0:1788940514.603735:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4b9b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.603753:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4b9b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.603767:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4b9b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.603859:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b9ab lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5ad7 expref: 63 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.603877:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4b9b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5ad7 expref: 62 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.603885:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff89f186946a00) 00010000:00010000:2.0:1788940514.603888:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788940514.603890:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f188dabe00, rc 0) 00000100:00100000:2.0:1788940514.603991:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1841d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+62:11628:x1875839718355840:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 1357us (1804us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1788940514.604001:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 219 00000100:00100000:1.0:1788940514.611898:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940514.612014:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718356096 00000100:00100000:3.0:1788940514.612025:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718356096 00000100:00100000:3.0:1788940514.612095:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 220 00000100:00100000:3.0:1788940514.612107:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1841dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+62:11628:x1875839718356096:12345-192.168.202.14@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788940514.612198:0:5862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940514.612415:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dabe00/0x27a633fcdd4b9b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5ad7 expref: 62 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940514.612440:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff89f186946a00) 00010000:00010000:3.0:1788940514.612467:0:5862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788940514.612884:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96000/0x27a633fcdd4b9c0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940514.612906:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96000/0x27a633fcdd4b9c0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940514.612920:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96000/0x27a633fcdd4b9c0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940514.612941:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97000/0x27a633fcdd4b9c7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xbd08bfc8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940514.612950:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97000/0x27a633fcdd4b9c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xbd08bfc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940514.612980:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97000/0x27a633fcdd4b9c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xbd08bfc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940514.613407:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96000/0x27a633fcdd4b9c0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940514.613417:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96000/0x27a633fcdd4b9c0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940514.613424:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96000/0x27a633fcdd4b9c0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940514.613430:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1bfa96000 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940514.613435:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96000/0x27a633fcdd4b9c0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940514.613443:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96000/0x27a633fcdd4b9c0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940514.613812:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89f1983af600) 00010000:00010000:3.0:1788940514.613817:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940514.613824:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96000/0x27a633fcdd4b9c0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940514.613832:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96000/0x27a633fcdd4b9c0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940514.613852:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97000/0x27a633fcdd4b9c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xbd08bfc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940514.613859:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97000/0x27a633fcdd4b9c7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xbd08bfc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940514.613885:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97000/0x27a633fcdd4b9c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xbd08bfc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940514.613892:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1bfa97000 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940514.613895:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97000/0x27a633fcdd4b9c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xbd08bfc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940514.613901:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97000/0x27a633fcdd4b9c7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xbd08bfc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940514.613909:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xbd08bfc8 (ffff89f18a6ced00) 00010000:00010000:3.0:1788940514.613912:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940514.613915:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97000/0x27a633fcdd4b9c7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xbd08bfc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940514.613920:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97000/0x27a633fcdd4b9c7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xbd08bfc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940514.614394:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1841dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+61:11628:x1875839718356096:12345-192.168.202.14@tcp:36:lhsmtool_posix.0 Request processed in 2281us (2503us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788940514.614406:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 220 00000100:00100000:3.0:1788940514.619430:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940514.619863:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718356224 00000100:00100000:2.0:1788940514.619878:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718356224 00000100:00100000:2.0:1788940514.620012:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 221 00000100:00100000:2.0:1788940514.620024:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf581f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+61:11628:x1875839718356224:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788940514.620052:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940514.620082:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b9ce lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5ade expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.620131:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b9d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.620160:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b9d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.620174:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b9d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.620337:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4b9ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5ade expref: 63 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.620358:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b9d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5ade expref: 62 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.620367:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff89f186946d00) 00010000:00010000:2.0:1788940514.620371:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788940514.620375:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f188daa600, rc 0) 00000100:00100000:2.0:1788940514.620854:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf581f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+62:11628:x1875839718356224:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 830us (1436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940514.620865:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 221 00000100:00100000:3.0:1788940514.625698:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940514.628839:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718356480 00000100:00100000:1.0:1788940514.628862:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718356480 00000100:00100000:1.0:1788940514.628970:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 222 00000100:00100000:1.0:1788940514.629103:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b55c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+62:11628:x1875839718356480:12345-192.168.202.14@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788940514.629355:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4b9dc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940514.629377:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4b9dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940514.629392:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4b9dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788940514.630389:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:1.0:1788940514.630422:0:5860:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 457528902874ns, next at 458528899633ns, rc = 0 00000004:00010000:1.0:1788940514.631957:0:5860:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d5d7c0c4 reply state 00000000db9b355f transno 4294967506 ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4b9dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940514.632116:0:5860:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788940514.632834:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b55c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+64:11628:x1875839718356480:12345-192.168.202.14@tcp:36:lhsmtool_posix.0 Request processed in 3729us (7144us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1788940514.632846:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 222 00000100:00100000:3.0:1788940514.639334:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00010000:00010000:2.0:1788940514.639469:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4b9dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.639484:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4b9dc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.639493:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4b9dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.639500:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258c200 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940514.639505:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4b9dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.639514:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4b9dc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.639550:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff89f186946d00) 00010000:00010000:2.0:1788940514.639571:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788940514.639579:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4b9dc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.639586:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4b9dc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940514.639903:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718356608 00000100:00100000:0.0:1788940514.639918:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718356608 00000100:00100000:0.0:1788940514.640175:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 223 00000100:00100000:0.0:1788940514.640190:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b55c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+63:11628:x1875839718356608:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788940514.640236:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940514.640272:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3400/0x27a633fcdd4b9e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5ae5 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940514.640353:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3400/0x27a633fcdd4b9e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5ae5 expref: 64 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940514.640369:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3400/0x27a633fcdd4b9e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5ae5 expref: 64 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940514.640389:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff89f186946d00) 00010000:00010000:0.0:1788940514.640392:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788940514.640395:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f082ad3400, rc 0) 00000100:00100000:0.0:1788940514.640487:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b55c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+64:11628:x1875839718356608:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 301us (1169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940514.640495:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 223 00000100:00100000:1.0:1788940514.645109:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940514.645329:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718356736 00000100:00100000:3.0:1788940514.645342:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718356736 00000100:00100000:3.0:1788940514.645430:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 62 00000100:00100000:3.0:1788940514.645441:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1841d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+9:2353:x1875839718356736:12345-192.168.202.14@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788940514.645916:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1841d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+10:2353:x1875839718356736:12345-192.168.202.14@tcp:2:lhsmtool_posix.0 Request processed in 474us (818us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1788940514.645926:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 62 00000100:00080000:0.0:1788940514.646593:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788940514.650339:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940514.653242:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718356992 00000100:00100000:2.0:1788940514.653263:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718356992 00000100:00100000:0.0:1788940514.653580:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 60 00000100:00100000:0.0:1788940514.653594:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1841d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+64:11628:x1875839718356992:12345-192.168.202.14@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788940514.653942:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1841d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+65:11628:x1875839718356992:12345-192.168.202.14@tcp:35:lhsmtool_posix.0 Request processed in 349us (3617us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1788940514.653950:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 60 00000100:00100000:1.0:1788940514.657797:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940514.658277:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718357248 00000100:00100000:2.0:1788940514.658291:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718357248 00000100:00100000:2.0:1788940514.658398:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 224 00000100:00100000:2.0:1788940514.658410:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1841da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+65:11628:x1875839718357248:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788940514.658608:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1841da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+65:11628:x1875839718357248:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 Request processed in 199us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940514.658617:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 224 00000100:00100000:3.0:1788940514.661134:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940514.662784:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718357376 00000100:00100000:1.0:1788940514.662802:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718357376 00000100:00100000:1.0:1788940514.662878:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 225 00000100:00100000:1.0:1788940514.662889:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b55c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+65:11628:x1875839718357376:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788940514.662921:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940514.662947:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4b9ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5aec expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940514.663310:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ce00/0x27a633fcdd4b9f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940514.663329:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ce00/0x27a633fcdd4b9f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940514.663343:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ce00/0x27a633fcdd4b9f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940514.663390:0:5860:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788940514.663411:0:5860:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ce00/0x27a633fcdd4b9f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940514.663544:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4b9ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5aec expref: 67 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940514.663565:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ce00/0x27a633fcdd4b9f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5aec expref: 66 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940514.663575:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff89f186946d00) 00010000:00010000:1.0:1788940514.663579:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788940514.663584:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f19258ce00, rc 0) 00000100:00100000:1.0:1788940514.663863:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b55c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+66:11628:x1875839718357376:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 975us (2741us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940514.663873:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 225 00000100:00100000:1.0:1788940514.667078:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940514.667251:0:12095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718357504 00000100:00100000:3.0:1788940514.667263:0:12095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718357504 00000100:00100000:3.0:1788940514.667323:0:12095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 63 00000100:00100000:3.0:1788940514.667334:0:12095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1841da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9c51ff78-d02d-4e61-8a10-a2f8830f1679+10:2352:x1875839718357504:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788940514.667357:0:12095:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940514.667382:0:12095:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008209f4d0/0x27a633fcdd4b9f8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5af3 expref: -99 pid: 12095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788940514.667414:0:12095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa110e3, blocks: 0x1 00010000:00010000:3.0:1788940514.667437:0:12095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=457s v=(0 0) 00010000:00010000:3.0:1788940514.667442:0:12095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940514.667462:0:12095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008209f4d0/0x27a633fcdd4b9f8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5af3 expref: 11 pid: 12095 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940514.667484:0:12095:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008209f4d0/0x27a633fcdd4b9f8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5af3 expref: 11 pid: 12095 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940514.667500:0:12095:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f1bfa97000, rc 0) 00000100:00100000:3.0:1788940514.667584:0:12095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1841da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9c51ff78-d02d-4e61-8a10-a2f8830f1679+11:2352:x1875839718357504:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 252us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940514.667591:0:12095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 63 00000100:00100000:1.0:1788940514.671599:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940514.671803:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718357760 00000100:00100000:0.0:1788940514.671816:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718357760 00000100:00100000:0.0:1788940514.671890:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 226 00000100:00100000:0.0:1788940514.671904:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4c25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+66:11628:x1875839718357760:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788940514.672057:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4c25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+66:11628:x1875839718357760:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 Request processed in 156us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940514.672074:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 226 00000100:00100000:0.0:1788940514.676679:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940514.676779:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718357888 00000100:00100000:2.0:1788940514.676791:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718357888 00000100:00100000:2.0:1788940514.676847:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 64 00000100:00100000:2.0:1788940514.676857:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f198181880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+11:11628:x1875839718357888:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788940514.676880:0:6708:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940514.676903:0:6708:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008522e9f7/0x27a633fcdd4b9ff lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5afa expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.676943:0:6708:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008209f4d0/0x27a633fcdd4b9f8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5af3 expref: 12 pid: 12095 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.676954:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940514.676974:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940514.676981:0:6708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008522e9f7/0x27a633fcdd4b9ff lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5afa expref: 12 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.677035:0:6708:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008209f4d0/0x27a633fcdd4b9f8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5af3 expref: 12 pid: 12095 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.677051:0:6708:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008209f4d0/0x27a633fcdd4b9f8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5af3 expref: 12 pid: 12095 timeout: 557 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940514.677069:0:6708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5626300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6708:1875839738269312:192.168.202.14@tcp:104: 00000100:00100000:2.0:1788940514.677186:0:6708:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1a95c89c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940514.680383:0:6708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5626300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6708:1875839738269312:192.168.202.14@tcp:104: 00010000:00010000:2.0:1788940514.680433:0:6708:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008522e9f7/0x27a633fcdd4b9ff lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5afa expref: 12 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.680472:0:6708:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f188daac00, rc 0) 00000100:00100000:2.0:1788940514.680577:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f198181880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+12:11628:x1875839718357888:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 3720us (3922us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940514.680587:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 64 00000100:00100000:1.0:1788940514.683885:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940514.684008:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718358016 00000100:00100000:0.0:1788940514.684021:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718358016 00010000:00010000:0.0:1788940514.684080:0:5845:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008209f4d0/0x27a633fcdd4b9f8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5af3 expref: 12 pid: 12095 timeout: 557 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940514.684131:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 82 00000100:00100000:0.0:1788940514.684149:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4c25880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+12:2352:x1875839718358016:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940514.684168:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940514.684199:0:5845:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008209f4d0/0x27a633fcdd4b9f8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5af3 expref: 12 pid: 12095 timeout: 557 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940514.684227:0:5845:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008209f4d0/0x27a633fcdd4b9f8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5af3 expref: 12 pid: 12095 timeout: 557 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940514.684256:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008209f4d0/0x27a633fcdd4b9f8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5af3 expref: 12 pid: 12095 timeout: 557 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940514.684279:0:5845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940514.684284:0:5845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940514.684295:0:5845:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008522e9f7/0x27a633fcdd4b9ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5afa expref: 11 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940514.684307:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008522e9f7/0x27a633fcdd4b9ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5afa expref: 11 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940514.684379:0:5845:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008522e9f7/0x27a633fcdd4b9ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5afa expref: 11 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940514.684397:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198181c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5845:1875839738269440:192.168.202.14@tcp:105: 00000100:00100000:0.0:1788940514.684581:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1862e4540 going to sleep for 11 seconds 00000100:00100000:1.0:1788940514.695546:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940514.695672:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198181c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5845:1875839738269440:192.168.202.14@tcp:105: 00010000:00010000:0.0:1788940514.695809:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940514.695884:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4c25880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+11:2352:x1875839718358016:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 11743us (12013us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940514.695898:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 82 00000100:00100000:3.0:1788940514.696368:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718358144 00000100:00100000:3.0:1788940514.696380:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718358144 00002000:00100000:3.0:1788940514.696440:0:6712:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff89f1b4c24000 x1875839718358144/t0(0) o4->9c51ff78-d02d-4e61-8a10-a2f8830f1679@192.168.202.14@tcp:490/0 lens 504/0 e 0 to 0 dl 1788940525 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788940514.696453:0:6712:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89f1b4c24000 with x1875839718358144 ext(0->12) 00002000:00010000:3.0:1788940514.696460:0:6712:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89f1b4c24000 00000100:00100000:3.0:1788940514.696504:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 6 00000100:00100000:3.0:1788940514.696515:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4c24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+11:2351:x1875839718358144:12345-192.168.202.14@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788940514.698014:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4c24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+13:2351:x1875839718358144:12345-192.168.202.14@tcp:4:lhsmtool_posix.0 Request processed in 1490us (2491us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1788940514.698028:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 6 00002000:00100000:3.0:1788940514.698039:0:6712:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff89f1b4c24000 x1875839718358144/t4294967320(0) o4->9c51ff78-d02d-4e61-8a10-a2f8830f1679@192.168.202.14@tcp:490/0 lens 504/448 e 0 to 0 dl 1788940525 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788940514.698049:0:6712:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89f1b4c24000 with x1875839718358144 ext(0->12) 00002000:00010000:3.0:1788940514.698056:0:6712:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89f1b4c24000 00000100:00100000:1.0:1788940514.702123:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940514.702320:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718358272 00000100:00100000:0.0:1788940514.702332:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718358272 00000100:00100000:0.0:1788940514.702416:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 227 00000100:00100000:0.0:1788940514.702429:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4c25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+66:11628:x1875839718358272:12345-192.168.202.14@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788940514.755134:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967507 is committed 00000100:00100000:0.0:1788940514.755835:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4c25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+65:11628:x1875839718358272:12345-192.168.202.14@tcp:44:lhsmtool_posix.0 Request processed in 53399us (53717us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940514.755848:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 227 00000020:00080000:1.0:1788940514.755963:0:5883:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89f184177900 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1788940514.755980:0:5883:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89f19068cd00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89f184177300 00000020:00080000:1.0:1788940514.755984:0:5883:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89f19068c900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89f1aefa4000 00000004:00080000:1.0:1788940514.756078:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:1.0:1788940514.756982:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:2.0:1788940514.757085:0:5894:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 6 committed batchid 5 00000004:00080000:1.0:1788940514.758155:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1788940514.758179:0:5883:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89f1b8bc1600 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1788940514.758185:0:5883:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89f18ded6000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89f1b8bc1a80 00000020:00080000:1.0:1788940514.758203:0:5883:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89f18ded6200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89f18de76400 00000020:00080000:2.0:1788940514.758845:0:5894:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:2.0:1788940514.758865:0:5894:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1788940514.758878:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788940514.758904:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738269568:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788940514.758987:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940514.759908:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b55c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738269824:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788940514.759949:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940514.759972:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788940514.759987:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198182d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738269696:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788940514.760012:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940514.760042:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738269568 00000100:00100000:2.0:1788940514.760049:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738269568 00000100:00100000:2.0:1788940514.760102:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738269824 00000100:00100000:2.0:1788940514.760104:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738269824 00000100:00100000:2.0:1788940514.760119:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738269696 00000100:00100000:2.0:1788940514.760121:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738269696 00000100:00100000:2.0:1788940514.760133:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788940514.760141:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5626300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3305:x1875839738269568:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788940514.760173:0:6707:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:2.0:1788940514.760205:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000644c5e36/0x27a633fcdd4ba06 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.760243:0:6707:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000817c3d73/0x27a633fcdd4b7c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a59 expref: 12 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.760255:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1788940514.760260:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788940514.760266:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000644c5e36/0x27a633fcdd4ba06 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.760303:0:6707:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000817c3d73/0x27a633fcdd4b7c8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a59 expref: 12 pid: 7074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.760337:0:6707:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000817c3d73/0x27a633fcdd4b7c8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a59 expref: 12 pid: 7074 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940514.760350:0:6707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5624380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6707:1875839738269952:192.168.202.14@tcp:104: 00000100:00100000:2.0:1788940514.760422:0:6707:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1a14900c0 going to sleep for 11 seconds 00000100:00080000:2.0:1788940514.760439:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788940514.760937:0:12095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788940514.760953:0:12095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5624e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3308:x1875839738269824:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788940514.760973:0:12095:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:3.0:1788940514.761020:0:12095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa110e2, atime: 0x6aa110e2, ctime: 0x6aa110e2, blocks: 0x1 00010000:00010000:3.0:1788940514.761028:0:12095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f22185a/0x27a633fcdd4ba0d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940514.761040:0:12095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=457s v=(0 0) 00010000:00010000:3.0:1788940514.761044:0:12095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940514.761050:0:12095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f22185a/0x27a633fcdd4ba0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940514.761080:0:12095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f22185a/0x27a633fcdd4ba0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940514.761093:0:12095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f22185a/0x27a633fcdd4ba0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940514.761102:0:12095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f22185a/0x27a633fcdd4ba0d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940514.761122:0:12095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788940514.761840:0:7074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788940514.761855:0:7074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5626680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3308:x1875839738269696:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788940514.762062:0:7074:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788940514.762066:0:7074:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788940515 00002000:00010000:0.0:1788940514.762068:0:7074:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788940514.762070:0:7074:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788940515 -> 1788940515 00002000:00010000:0.0:1788940514.762081:0:7074:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788940514.762194:0:7074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5626680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3308:x1875839738269696:12345-0@lo:2:osp-syn-0-0.0 Request processed in 343us (2178us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1788940514.762203:0:7074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788940514.763185:0:12095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5624e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3308:x1875839738269824:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2233us (3229us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788940514.763197:0:12095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00010000:3.0:1788940514.763243:0:7649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940514.763253:0:7649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f22185a/0x27a633fcdd4ba0d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940514.763268:0:7649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1bfa97800 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:3.0:1788940514.763274:0:7649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f22185a/0x27a633fcdd4ba0d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940514.763288:0:7649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f22185a/0x27a633fcdd4ba0d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940514.763311:0:7649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f22185a/0x27a633fcdd4ba0d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940514.763328:0:7649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f22185a/0x27a633fcdd4ba0d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940514.763352:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940514.763354:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940514.763356:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788940514.763821:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89f198182d80/2, rc 0, transno 4294967321 00000100:00100000:2.0:1788940514.763831:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198182d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738269696:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1788940514.763846:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89f1b55c3b80/2, rc 0, transno 4294967310 00000100:00100000:2.0:1788940514.763849:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b55c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738269824:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788940514.769220:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940514.769307:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718358400 00000100:00100000:3.0:1788940514.769319:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718358400 00010000:00010000:3.0:1788940514.769373:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000817c3d73/0x27a633fcdd4b7c8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a59 expref: 13 pid: 7074 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940514.769425:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 83 00000100:00100000:3.0:1788940514.769434:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4c24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+13:2352:x1875839718358400:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940514.769462:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940514.769470:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000817c3d73/0x27a633fcdd4b7c8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a59 expref: 13 pid: 7074 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940514.769486:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000817c3d73/0x27a633fcdd4b7c8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a59 expref: 13 pid: 7074 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940514.769556:0:5847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788940514.769561:0:5847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788940514.769577:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000644c5e36/0x27a633fcdd4ba06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940514.769614:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000644c5e36/0x27a633fcdd4ba06 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940514.769641:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940514.769707:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4c24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+13:2352:x1875839718358400:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 273us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940514.769715:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 83 00010000:00010000:2.0:1788940514.771042:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000817c3d73/0x27a633fcdd4b7c8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a59 expref: 12 pid: 7074 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940514.771068:0:6707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5624380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6707:1875839738269952:192.168.202.14@tcp:104: 00010000:00010000:2.0:1788940514.771104:0:6707:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000644c5e36/0x27a633fcdd4ba06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.771117:0:6707:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000644c5e36/0x27a633fcdd4ba06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.771126:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000644c5e36/0x27a633fcdd4ba06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.771319:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000644c5e36/0x27a633fcdd4ba06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.771328:0:6707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000644c5e36/0x27a633fcdd4ba06 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.771445:0:6707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788940514.772243:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5626300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3305:x1875839738269568:12345-0@lo:6:osp-syn-0-0.0 Request processed in 12099us (13251us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1788940514.772254:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000004:00080000:0.0:1788940514.772623:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89f198181c00/2, rc 0, transno 4294967322 00000100:00100000:0.0:1788940514.772632:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738269568:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788940514.775882:0:7648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940514.775904:0:7648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000644c5e36/0x27a633fcdd4ba06 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940514.775924:0:7648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188daaa00 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:3.0:1788940514.775931:0:7648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000644c5e36/0x27a633fcdd4ba06 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940514.775946:0:7648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000644c5e36/0x27a633fcdd4ba06 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940514.775973:0:7648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000644c5e36/0x27a633fcdd4ba06 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940514.775995:0:7648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000644c5e36/0x27a633fcdd4ba06 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940514.776502:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940514.776620:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718358528 00000100:00100000:3.0:1788940514.776649:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718358528 00000100:00100000:3.0:1788940514.776723:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 68 00000100:00100000:3.0:1788940514.776735:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4c27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+12:2352:x1875839718358528:12345-192.168.202.14@tcp:16:lhsmtool_posix.0 00010000:00010000:2.0:1788940514.787156:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940514.787168:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940514.787171:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788940514.844913:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000001:00080000:3.0:1788940514.844940:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:3.0:1788940514.844946:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:3.0:1788940514.844961:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000100:00100000:1.0:1788940514.845236:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4c27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+7:2352:x1875839718358528:12345-192.168.202.14@tcp:16:lhsmtool_posix.0 Request processed in 68494us (68733us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940514.845251:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 68 00000100:00100000:1.0:1788940514.848963:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940514.849265:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718358784 00000100:00100000:0.0:1788940514.849279:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718358784 00000100:00100000:0.0:1788940514.849354:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 228 00000100:00100000:0.0:1788940514.849367:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4c27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+20:11628:x1875839718358784:12345-192.168.202.14@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788940514.849443:0:7857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940514.849481:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ce00/0x27a633fcdd4b9f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5aec expref: 20 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940514.849504:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff89f186946d00) 00010000:00010000:0.0:1788940514.849510:0:7857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788940514.849607:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4ba14 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940514.849625:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4ba14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940514.849638:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4ba14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788940514.850572:0:7857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000033e91834 reply state 0000000009a7471d transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4ba14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940514.850587:0:7857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788940514.850736:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4c27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+21:11628:x1875839718358784:12345-192.168.202.14@tcp:36:lhsmtool_posix.0 Request processed in 1369us (1785us total) trans 4294967508 rc 0/0 00000100:00100000:0.0:1788940514.850744:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 228 00010000:00010000:1.0:1788940514.855976:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4ba14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940514.856008:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4ba14 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940514.856017:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4ba14 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940514.856023:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad3800 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940514.856029:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4ba14 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940514.856037:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4ba14 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940514.856064:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff89f186946d00) 00010000:00010000:1.0:1788940514.856067:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940514.856077:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4ba14 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940514.856085:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4ba14 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940514.858041:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940514.858457:0:12095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718358912 00000100:00100000:3.0:1788940514.858471:0:12095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718358912 00000100:00100000:3.0:1788940514.858826:0:12095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 69 00000100:00100000:3.0:1788940514.858840:0:12095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4c27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9c51ff78-d02d-4e61-8a10-a2f8830f1679+7:2352:x1875839718358912:12345-192.168.202.14@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788940514.859430:0:12095:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1788940514.859436:0:12095:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1788940515 -> 1788940515 00002000:00010000:3.0:1788940514.859439:0:12095:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788940514 00002000:00010000:3.0:1788940514.859441:0:12095:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788940515 -> 1788940515 00002000:00010000:3.0:1788940514.859443:0:12095:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788940514.862447:0:12095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4c27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9c51ff78-d02d-4e61-8a10-a2f8830f1679+8:2352:x1875839718358912:12345-192.168.202.14@tcp:2:lhsmtool_posix.0 Request processed in 3593us (4408us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1788940514.862466:0:12095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 69 00000100:00100000:0.0:1788940514.866380:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940514.866484:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718359168 00000100:00100000:2.0:1788940514.866496:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718359168 00000100:00100000:2.0:1788940514.866861:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 229 00000100:00100000:2.0:1788940514.866873:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f198183800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+20:11628:x1875839718359168:12345-192.168.202.14@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788940514.866959:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4ba1b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.866978:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b9d5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5ade expref: 20 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.866991:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4ba1b lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.867041:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b9d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5ade expref: 20 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.867071:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b9d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5ade expref: 20 pid: 5861 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940514.867087:0:5861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5624380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5861:1875839738270080:192.168.202.14@tcp:104: 00000100:00100000:2.0:1788940514.867309:0:5861:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1a14900c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788940514.870515:0:5861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5624380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5861:1875839738270080:192.168.202.14@tcp:104: 00010000:00010000:3.0:1788940514.870599:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4ba1b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940514.873542:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940514.874510:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718359296 00000100:00100000:3.0:1788940514.874546:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718359296 00010000:00010000:3.0:1788940514.874597:0:8470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b9d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5ade expref: 21 pid: 5861 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940514.874660:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 84 00000100:00100000:3.0:1788940514.874773:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4c26d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+21:2353:x1875839718359296:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940514.874789:0:8470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940514.874797:0:8470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b9d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5ade expref: 21 pid: 5861 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940514.874813:0:8470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b9d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5ade expref: 21 pid: 5861 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940514.874840:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4b9d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5ade expref: 21 pid: 5861 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940514.874861:0:8470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff89f186946d00) 00010000:00010000:3.0:1788940514.874867:0:8470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4ba1b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940514.874878:0:8470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4ba1b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940514.874887:0:8470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4ba1b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940514.874979:0:8470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940514.875057:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4c26d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+20:2353:x1875839718359296:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 287us (1536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940514.875065:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 84 00010000:00010000:2.0:1788940514.877340:0:5861:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4ba1b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.877361:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4ba1b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.877402:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4ba1b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.877409:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4ba1b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.877417:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4ba1b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.877423:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188dab400 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940514.877428:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4ba1b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.877436:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4ba1b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.877578:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff89f186946d00) 00010000:00010000:2.0:1788940514.877582:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788940514.877609:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4ba1b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.877616:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4ba1b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940514.877912:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f198183800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+19:11628:x1875839718359168:12345-192.168.202.14@tcp:55:lhsmtool_posix.0 Request processed in 11035us (11539us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788940514.877925:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 229 00000100:00100000:1.0:1788940514.881626:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940514.881726:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718359424 00000100:00100000:2.0:1788940514.881739:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718359424 00000100:00100000:2.0:1788940514.881797:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 70 00000100:00100000:2.0:1788940514.881806:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4c26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+8:2353:x1875839718359424:12345-192.168.202.14@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788940514.881868:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000644c5e36/0x27a633fcdd4ba22 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.881894:0:6707:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008522e9f7/0x27a633fcdd4b9ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5afa expref: 8 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.881905:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940514.881909:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788940514.881915:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000644c5e36/0x27a633fcdd4ba22 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.881954:0:6707:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008522e9f7/0x27a633fcdd4b9ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5afa expref: 8 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.881969:0:6707:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008522e9f7/0x27a633fcdd4b9ff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5afa expref: 8 pid: 6708 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940514.882014:0:6707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5625180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6707:1875839738270208:192.168.202.14@tcp:104: 00000100:00100000:2.0:1788940514.882108:0:6707:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1a14900c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788940514.889657:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940514.889886:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718359552 00000100:00100000:3.0:1788940514.889914:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718359552 00010000:00010000:3.0:1788940514.889967:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008522e9f7/0x27a633fcdd4b9ff lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5afa expref: 9 pid: 6708 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940514.890031:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 85 00000100:00100000:3.0:1788940514.890042:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4c26300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+9:2353:x1875839718359552:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940514.890060:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940514.890094:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008522e9f7/0x27a633fcdd4b9ff lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5afa expref: 9 pid: 6708 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940514.890110:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008522e9f7/0x27a633fcdd4b9ff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5afa expref: 9 pid: 6708 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940514.890144:0:5847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788940514.890150:0:5847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788940514.890157:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000644c5e36/0x27a633fcdd4ba22 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940514.890170:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000644c5e36/0x27a633fcdd4ba22 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940514.890195:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940514.890279:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4c26300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+9:2353:x1875839718359552:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 238us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940514.890287:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 85 00010000:00010000:2.0:1788940514.893024:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008522e9f7/0x27a633fcdd4b9ff lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5afa expref: 8 pid: 6708 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940514.893059:0:6707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5625180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6707:1875839738270208:192.168.202.14@tcp:104: 00010000:00010000:2.0:1788940514.893096:0:6707:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000644c5e36/0x27a633fcdd4ba22 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.893111:0:6707:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000644c5e36/0x27a633fcdd4ba22 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.893119:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000644c5e36/0x27a633fcdd4ba22 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.893177:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000644c5e36/0x27a633fcdd4ba22 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.893187:0:6707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000644c5e36/0x27a633fcdd4ba22 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.893197:0:6707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000644c5e36/0x27a633fcdd4ba22 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.893245:0:6707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188daaa00 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:2.0:1788940514.893250:0:6707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000644c5e36/0x27a633fcdd4ba22 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.893261:0:6707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000644c5e36/0x27a633fcdd4ba22 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.893285:0:6707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000644c5e36/0x27a633fcdd4ba22 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.893293:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000644c5e36/0x27a633fcdd4ba22 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940514.893413:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4c26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+7:2353:x1875839718359424:12345-192.168.202.14@tcp:1:lhsmtool_posix.0 Request processed in 11606us (11799us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940514.893424:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 70 00000100:00100000:1.0:1788940514.899444:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940514.899819:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718359808 00000100:00100000:2.0:1788940514.899832:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718359808 00000100:00100000:2.0:1788940514.899908:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 230 00000100:00100000:2.0:1788940514.899920:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4c24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+19:11628:x1875839718359808:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788940514.900036:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4ba29 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.900059:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4ba29 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.900097:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4ba29 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.900402:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4ba30 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.900416:0:5860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3400/0x27a633fcdd4b9e3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5ae5 expref: 20 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.900427:0:5860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4ba30 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.900469:0:5860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3400/0x27a633fcdd4b9e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5ae5 expref: 20 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.900483:0:5860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3400/0x27a633fcdd4b9e3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5ae5 expref: 20 pid: 5861 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940514.900498:0:5860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5625180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5860:1875839738270336:192.168.202.14@tcp:104: 00000100:00100000:2.0:1788940514.900641:0:5860:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1a14900c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788940514.903756:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940514.903795:0:5860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5625180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5860:1875839738270336:192.168.202.14@tcp:104: 00010000:00010000:2.0:1788940514.903831:0:5860:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4ba30 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940514.903894:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718359936 00000100:00100000:0.0:1788940514.903902:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718359936 00010000:00010000:0.0:1788940514.903943:0:5845:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3400/0x27a633fcdd4b9e3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5ae5 expref: 21 pid: 5861 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940514.903979:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 86 00000100:00100000:0.0:1788940514.903988:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1923c7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+21:2353:x1875839718359936:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940514.904018:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940514.904027:0:5845:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3400/0x27a633fcdd4b9e3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5ae5 expref: 21 pid: 5861 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940514.904038:0:5845:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3400/0x27a633fcdd4b9e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5ae5 expref: 21 pid: 5861 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940514.904060:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3400/0x27a633fcdd4b9e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5ae5 expref: 21 pid: 5861 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940514.904074:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff89f186946d00) 00010000:00010000:0.0:1788940514.904079:0:5845:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4ba30 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940514.904087:0:5845:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4ba30 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940514.904093:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4ba30 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940514.904134:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788940514.904159:0:5860:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4ba30 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.904166:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4ba30 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940514.904208:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1923c7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+20:2353:x1875839718359936:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 221us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940514.904227:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 86 00000001:00080000:2.0:1788940514.904570:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:2.0:1788940514.904772:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:2.0:1788940514.904824:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1788940514.904923:0:5860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5625180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5860:1875839738270464:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788940514.904987:0:5860:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940514.905017:0:5860:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f190e43f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788940514.905060:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738270464 00000100:00100000:0.0:1788940514.905066:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738270464 00000100:00100000:0.0:1788940514.905110:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788940514.905119:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5624380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5860:x1875839738270464:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788940514.905660:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5624380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5860:x1875839738270464:12345-0@lo:1000:mdt00_000.0 Request processed in 540us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940514.905670:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788940514.905800:0:5860:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:2.0:1788940514.905809:0:5860:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967322 00000004:00080000:2.0:1788940514.905837:0:5860:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89f198182d80, transno 4294967321 00000004:00080000:2.0:1788940514.905884:0:5860:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89f198181c00, transno 4294967322 00000100:00100000:2.0:1788940514.906628:0:5860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5625180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5860:1875839738270464:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1788940514.914626:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:1.0:1788940514.915231:0:5860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4c26680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5860:1875839738270592:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788940514.915332:0:5860:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940514.915438:0:5860:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f198099000 going to sleep for 11 seconds 00000100:00100000:0.0:1788940514.917239:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738270592 00000100:00100000:0.0:1788940514.917258:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738270592 00000100:00100000:1.0:1788940514.917577:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788940514.917590:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4c24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5860:x1875839738270592:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788940514.917971:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4c24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5860:x1875839738270592:12345-0@lo:1000:mdt00_000.0 Request processed in 383us (2638us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1788940514.917979:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788940514.918166:0:5860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4c26680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5860:1875839738270592:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1788940514.918238:0:5860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4ba30 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.918251:0:5860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4ba30 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.918259:0:5860:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4ba30 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.918266:0:5860:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188dab600 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940514.918272:0:5860:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4ba30 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.918282:0:5860:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4ba30 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.918324:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff89f186946d00) 00010000:00010000:2.0:1788940514.918328:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788940514.918334:0:5860:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4ba30 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.918341:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4ba30 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.918382:0:5860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4b973 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.918388:0:5860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4b973 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.918394:0:5860:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4b973 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.918399:0:5860:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188daa400 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940514.918403:0:5860:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4b973 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.918409:0:5860:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4b973 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.918418:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89f186946600) 00010000:00010000:2.0:1788940514.918420:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788940514.918429:0:5860:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97e00/0x27a633fcdd4b97a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5ac9 expref: 23 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.918442:0:5860:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97e00/0x27a633fcdd4b97a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5ac9 expref: 23 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.918935:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97e00/0x27a633fcdd4b97a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5ac9 expref: 23 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.918990:0:5860:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97e00/0x27a633fcdd4b97a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5ac9 expref: 23 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940514.919017:0:5860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5627800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5860:1875839738270720:192.168.202.14@tcp:105: 00000100:00100000:2.0:1788940514.919127:0:5860:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f190e43f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788940514.923457:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940514.923514:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718360064 00000100:00100000:3.0:1788940514.923556:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718360064 00000100:00100000:3.0:1788940514.923634:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 61 00000100:00100000:3.0:1788940514.923644:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4c25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+24:11627:x1875839718360064:12345-192.168.202.14@tcp:49:lfs.0 00000100:00100000:2.0:1788940514.923645:0:5860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5627800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5860:1875839738270720:192.168.202.14@tcp:105: 00010000:00010000:2.0:1788940514.923681:0:5860:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4b973 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.923701:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa400/0x27a633fcdd4b973 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.923740:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4ba37 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.923757:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4ba37 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.923771:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4ba37 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.923781:0:5860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4ba37 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.923787:0:5860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4ba37 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.923800:0:5860:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4ba37 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.923807:0:5860:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188dab600 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940514.923811:0:5860:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4ba37 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.923819:0:5860:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4ba37 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.923837:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89f186946600) 00010000:00010000:2.0:1788940514.923841:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940514.923845:0:5860:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4ba37 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.923851:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab600/0x27a633fcdd4ba37 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.923861:0:5860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4ba29 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.923867:0:5860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4ba29 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.923873:0:5860:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4ba29 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940514.923874:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4c25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+24:11627:x1875839718360064:12345-192.168.202.14@tcp:49:lfs.0 Request processed in 231us (436us total) trans 0 rc 0/0 00010000:00010000:2.0:1788940514.923879:0:5860:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188dab400 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940514.923881:0:5860:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4ba29 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940514.923883:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 61 00010000:00010000:2.0:1788940514.923896:0:5860:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4ba29 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.923905:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89f186946600) 00010000:00010000:2.0:1788940514.923907:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788940514.923910:0:5860:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4ba29 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.923916:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4ba29 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940514.924202:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4c24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+23:11628:x1875839718359808:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 Request processed in 24283us (24772us total) trans 4294967513 rc 0/0 00000100:00100000:2.0:1788940514.924223:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 230 00000020:00080000:2.0:1788940514.924228:0:5860:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788940514.926897:0:11708:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788940514.926910:0:11708:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788940514.927449:0:11708:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1788940514.927461:0:11708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788940514.929197:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940514.930339:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718360320 00000100:00100000:0.0:1788940514.930355:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718360320 00000100:00100000:0.0:1788940514.930493:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 231 00000100:00100000:0.0:1788940514.930507:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5627800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+23:11627:x1875839718360320:12345-192.168.202.14@tcp:58:lfs.0 00000100:00100000:1.0:1788940514.930947:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000040:00080000:0.0:1788940514.931033:0:5862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1788940514.931079:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718360576 00000100:00100000:3.0:1788940514.931084:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718360576 00000100:00100000:3.0:1788940514.931127:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 62 00000100:00100000:0.0:1788940514.931128:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5627800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+24:11627:x1875839718360320:12345-192.168.202.14@tcp:58:lfs.0 Request processed in 624us (1942us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940514.931135:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b05cf450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+24:11628:x1875839718360576:12345-192.168.202.14@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788940514.931137:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 231 00000004:00080000:3.0:1788940514.933349:0:5863:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788940514.933458:0:5863:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00010000:00010000:3.0:1788940514.940813:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97800/0x27a633fcdd4ba3e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940514.940846:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97800/0x27a633fcdd4ba3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940514.940862:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97800/0x27a633fcdd4ba3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940514.940875:0:5863:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97800/0x27a633fcdd4ba3e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940514.940882:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97800/0x27a633fcdd4ba3e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940514.940909:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97800/0x27a633fcdd4ba3e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940514.941026:0:5863:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788940514.941186:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b05cf450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+25:11628:x1875839718360576:12345-192.168.202.14@tcp:35:lhsmtool_posix.0 Request processed in 10044us (10233us total) trans 4294967515 rc 0/0 00000100:00100000:3.0:1788940514.941198:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 62 00000020:00080000:3.0:1788940514.941205:0:5863:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788940514.948773:0:5848:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940514.948797:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97800/0x27a633fcdd4ba3e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940514.948812:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1bfa97800 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:1.0:1788940514.948817:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97800/0x27a633fcdd4ba3e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940514.948830:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97800/0x27a633fcdd4ba3e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940514.948878:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff89f18a6cec00) 00010000:00010000:1.0:1788940514.948882:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788940514.948888:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97800/0x27a633fcdd4ba3e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940514.948896:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97800/0x27a633fcdd4ba3e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940514.948930:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940514.948932:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940514.948935:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940514.987027:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940514.987150:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718360704 00000100:00100000:0.0:1788940514.987163:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718360704 00000100:00100000:0.0:1788940514.987250:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 232 00000100:00100000:0.0:1788940514.987262:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4c25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+25:11630:x1875839718360704:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:0.0:1788940514.987305:0:7857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940514.987348:0:7857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3400/0x27a633fcdd4ba45 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5b01 expref: -99 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940514.987436:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4ba4c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940514.987454:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4ba4c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940514.987468:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4ba4c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940514.987484:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4ba53 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940514.987493:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4ba53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940514.987499:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4ba53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.988255:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4ba5a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.988272:0:7857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b965 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5ac2 expref: 26 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.988281:0:7857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4ba5a lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.988327:0:7857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b965 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5ac2 expref: 26 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.988344:0:7857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b965 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5ac2 expref: 26 pid: 7857 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940514.988369:0:7857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5625880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7857:1875839738270848:192.168.202.14@tcp:104: 00000100:00100000:2.0:1788940514.988562:0:7857:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f190e43f00 going to sleep for 11 seconds 00010000:00010000:0.0:1788940514.990192:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940514.991758:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940514.992058:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718360960 00000100:00100000:1.0:1788940514.992069:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718360960 00000100:00100000:1.0:1788940514.992145:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 63 00000100:00100000:1.0:1788940514.992157:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b55c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+27:5595:x1875839718360960:12345-192.168.202.14@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788940514.995267:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b55c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+28:5595:x1875839718360960:12345-192.168.202.14@tcp:35:ldlm_bl.0 Request processed in 3092us (3500us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1788940514.995287:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 63 00000100:00100000:0.0:1788940514.995465:0:7857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5625880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7857:1875839738270848:192.168.202.14@tcp:104: 00010000:00010000:0.0:1788940514.995741:0:7857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4ba5a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940514.997981:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940514.998278:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718361088 00000100:00100000:0.0:1788940514.998293:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718361088 00010000:00010000:0.0:1788940514.998353:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b965 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5ac2 expref: 28 pid: 7857 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940514.998394:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 87 00000100:00100000:0.0:1788940514.998423:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4c24700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+28:2352:x1875839718361088:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940514.998442:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940514.998450:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b965 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5ac2 expref: 28 pid: 7857 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940514.998461:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b965 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5ac2 expref: 28 pid: 7857 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940514.998488:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2800/0x27a633fcdd4b965 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5ac2 expref: 28 pid: 7857 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940514.998764:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89f186946600) 00010000:00010000:0.0:1788940514.998771:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4ba5a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940514.998782:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4ba5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940514.998790:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4ba5a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940514.998822:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788940514.998868:0:7857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4ba5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.998878:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4ba5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940514.998903:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4c24700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+27:2352:x1875839718361088:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 482us (947us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940514.998910:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 87 00000004:00200000:2.0:1788940514.998938:0:7857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788940514.998943:0:7857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788940514.999042:0:7857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4ba5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.999057:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4ba5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.999067:0:7857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4ba4c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.999075:0:7857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4ba4c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.999081:0:7857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4ba4c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.999088:0:7857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad2e00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940514.999093:0:7857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4ba4c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.999101:0:7857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4ba4c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.999662:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89f1983af600) 00010000:00010000:2.0:1788940514.999665:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940514.999671:0:7857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4ba4c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.999678:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4ba4c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.999696:0:7857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4ba53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.999703:0:7857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4ba53 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.999709:0:7857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4ba53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.999716:0:7857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad2000 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940514.999719:0:7857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4ba53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.999726:0:7857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4ba53 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.999739:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff89f1983af800) 00010000:00010000:2.0:1788940514.999741:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940514.999744:0:7857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4ba53 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.999749:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2000/0x27a633fcdd4ba53 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.999811:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3400/0x27a633fcdd4ba45 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5b01 expref: 27 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.999826:0:7857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4ba5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5b01 expref: 26 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940514.999834:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89f186946600) 00010000:00010000:2.0:1788940514.999835:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788940514.999838:0:7857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f188dab400, rc 0) 00000100:00100000:2.0:1788940514.999885:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4c25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+26:11630:x1875839718360704:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 12625us (12874us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940514.999893:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 232 00000040:00080000:1.0:1788940515.800462:0:12595:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788940515.800473:0:12595:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788940515.801399:0:12595:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788940515.801407:0:12595:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1788940515.951721:0:11708:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788940515.951731:0:11708:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788940515.951767:0:11708:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788940515.951774:0:11708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788940515.951925:0:11708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198182d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11708:1875839738270976:192.168.202.14@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788940515.955005:0:11708:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1a95c8780 going to sleep for 11 seconds 00000100:00100000:3.0:1788940515.961840:0:11708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198182d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11708:1875839738270976:192.168.202.14@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788940515.978937:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940515.982941:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718361216 00000100:00100000:2.0:1788940515.982958:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718361216 00000100:00100000:2.0:1788940515.984442:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 233 00000100:00100000:2.0:1788940515.984468:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b55c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+26:11642:x1875839718361216:12345-192.168.202.14@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788940515.984513:0:5861:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788940515.985247:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b55c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+26:11642:x1875839718361216:12345-192.168.202.14@tcp:53:lhsmtool_posix.0 Request processed in 788us (6728us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940515.985257:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 233 00000100:00100000:0.0:1788940515.997606:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940515.999545:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718361472 00000100:00100000:3.0:1788940515.999562:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718361472 00000100:00100000:3.0:1788940515.999628:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 234 00000100:00100000:3.0:1788940515.999639:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f198183b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+26:11642:x1875839718361472:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788940515.999661:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940515.999682:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96000/0x27a633fcdd4ba61 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5b08 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940515.999786:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96e00/0x27a633fcdd4ba68 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940515.999800:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96e00/0x27a633fcdd4ba68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940515.999814:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96e00/0x27a633fcdd4ba68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940515.999842:0:5860:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788940515.999966:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96000/0x27a633fcdd4ba61 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5b08 expref: 29 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940515.999987:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96e00/0x27a633fcdd4ba68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5b08 expref: 28 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940515.999996:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89f186946600) 00010000:00010000:3.0:1788940515.999999:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788940516.000003:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f1bfa96e00, rc 0) 00000100:00100000:3.0:1788940516.000065:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f198183b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+28:11642:x1875839718361472:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 428us (2469us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1788940516.000072:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 234 00000100:00100000:2.0:1788940516.005698:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940516.005746:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718361728 00000100:00100000:2.0:1788940516.005759:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718361728 00000100:00100000:2.0:1788940516.005832:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 235 00000100:00100000:2.0:1788940516.005844:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5627b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+28:11642:x1875839718361728:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788940516.005949:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4ba76 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940516.005967:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4ba76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940516.005979:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4ba76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940516.007223:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940516.007262:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718361856 00000100:00100000:3.0:1788940516.007270:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718361856 00000100:00080000:1.0:1788940516.007708:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940516.007739:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 18 00000100:00100000:1.0:1788940516.007752:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b55c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+29:2352:x1875839718361856:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788940516.007787:0:8470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940516.007813:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96e00/0x27a633fcdd4ba68 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5b08 expref: 29 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940516.007827:0:8470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89f186946600) 00010000:00010000:1.0:1788940516.007832:0:8470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940516.007887:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b55c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+28:2352:x1875839718361856:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 138us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940516.007895:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 18 00010000:00010000:2.0:1788940516.008803:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4ba76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940516.008814:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4ba76 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940516.008822:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4ba76 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940516.008828:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188daac00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940516.008832:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4ba76 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940516.008840:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4ba76 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940516.008851:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89f186946600) 00010000:00010000:2.0:1788940516.008854:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788940516.008858:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4ba76 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940516.008864:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daac00/0x27a633fcdd4ba76 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940516.009011:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5627b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+28:11642:x1875839718361728:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 Request processed in 3167us (3322us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1788940516.009021:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 235 00010000:00010000:3.0:1788940516.017760:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940516.017834:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940516.017868:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718362112 00000100:00100000:3.0:1788940516.017879:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718362112 00000100:00100000:3.0:1788940516.017937:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 64 00000100:00100000:3.0:1788940516.017951:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b55c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+28:11642:x1875839718362112:12345-192.168.202.14@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788940516.018187:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b55c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+29:11642:x1875839718362112:12345-192.168.202.14@tcp:35:lhsmtool_posix.0 Request processed in 240us (358us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1788940516.018194:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 64 00000040:00080000:1.0:1788940516.019022:0:11708:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788940516.019029:0:11708:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788940516.019684:0:11708:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788940516.019696:0:11708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788940517.037336:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940517.370164:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940517.370218:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940517.370261:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940517.370297:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940517.370341:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940517.370386:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718362624 00000100:00100000:1.0:1788940517.370400:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718362624 00000100:00100000:1.0:1788940517.370491:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718362496 00000100:00100000:1.0:1788940517.370497:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718362496 00000100:00100000:1.0:1788940517.370564:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 102 00000100:00100000:1.0:1788940517.370581:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4c25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+7:2351:x1875839718362624:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788940517.370694:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4c25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+7:2351:x1875839718362624:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 119us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940517.370714:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 102 00000100:00100000:1.0:1788940517.370732:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 103 00000100:00100000:1.0:1788940517.370739:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4c25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+7:2351:x1875839718362496:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788940517.370768:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4c25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+7:2351:x1875839718362496:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 29us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940517.370773:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 103 00000100:00100000:1.0:1788940517.370796:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718362368 00000100:00100000:1.0:1788940517.370800:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718362368 00000100:00100000:1.0:1788940517.370825:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718362752 00000100:00100000:1.0:1788940517.370828:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718362752 00000100:00100000:1.0:1788940517.370849:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 183 00000100:00100000:1.0:1788940517.370855:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4c27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+29:2351:x1875839718362368:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788940517.370890:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4c27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+29:2351:x1875839718362368:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 35us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940517.370896:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 183 00000100:00100000:1.0:1788940517.370908:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 184 00000100:00100000:1.0:1788940517.370914:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4c24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffa310cd-169f-42e3-8999-506116bada08+5:2351:x1875839718362752:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788940517.374998:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4c24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffa310cd-169f-42e3-8999-506116bada08+5:2351:x1875839718362752:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 30us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940517.375034:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 184 00000100:00080000:1.0:1788940517.375224:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788940517.375231:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788940517.375234:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788940517.375634:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718362240 00000100:00100000:0.0:1788940517.375657:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718362240 00000100:00100000:0.0:1788940517.375709:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 311 00000100:00100000:0.0:1788940517.375720:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18416ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:2351:x1875839718362240:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788940517.375791:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18416ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:2351:x1875839718362240:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 73us (5530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940517.375798:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 311 00000001:00080000:3.0:1788940517.438998:0:7662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:3.0:1788940517.439039:0:7662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:3.0:1788940517.439046:0:7662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000100:00100000:2.0:1788940517.869036:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4c26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738271104:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788940517.869131:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940517.869275:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738271104 00000100:00100000:1.0:1788940517.869285:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738271104 00000100:00100000:1.0:1788940517.869363:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788940517.869373:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5625880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1875839738271104:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788940517.869373:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198182d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3306:1875839738271232:0@lo:400:kworker.0 00000100:00100000:0.0:1788940517.869409:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1788940517.869413:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788940517.869433:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b500f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738271744:0@lo:400:kworker.0 00000100:00100000:1.0:1788940517.869455:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5625880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1875839738271104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940517.869458:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940517.869462:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788940517.869475:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788940517.869481:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875839738271616:0@lo:400:kworker.0 00000100:00100000:0.0:1788940517.869505:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788940517.869615:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788940517.869751:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738271616 00000100:00100000:1.0:1788940517.869755:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738271616 00000100:00100000:1.0:1788940517.869795:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788940517.869802:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae7caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875839738271616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940517.869842:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae7caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875839738271616:12345-0@lo:400:kworker.0 Request processed in 41us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940517.869848:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00080000:2.0:1788940517.869905:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788940517.870064:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f198181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875839738271360:0@lo:400:kworker.0 00000100:00100000:0.0:1788940517.870095:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940517.870131:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788940517.870138:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875839738271488:0@lo:400:kworker.0 00000100:00100000:0.0:1788940517.870159:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940517.870206:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738271232 00000100:00100000:0.0:1788940517.870210:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738271232 00000100:00100000:0.0:1788940517.870236:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1788940517.870242:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18416dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3306:x1875839738271232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940517.870278:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18416dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3306:x1875839738271232:12345-0@lo:400:kworker.0 Request processed in 36us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940517.870284:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1788940517.870311:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738271744 00000100:00100000:0.0:1788940517.870314:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738271744 00000100:00100000:0.0:1788940517.870346:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788940517.870351:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f0821c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738271744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940517.870379:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f0821c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738271744:12345-0@lo:400:kworker.0 Request processed in 28us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940517.870384:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788940517.870400:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738271360 00000100:00100000:0.0:1788940517.870404:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738271360 00000100:00100000:0.0:1788940517.870421:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738271488 00000100:00100000:0.0:1788940517.870423:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738271488 00000100:00100000:0.0:1788940517.870441:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788940517.870446:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae7cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875839738271360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940517.870477:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae7cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875839738271360:12345-0@lo:400:kworker.0 Request processed in 30us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940517.870482:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788940517.870492:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788940517.870498:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b48a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875839738271488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940517.870539:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b48a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875839738271488:12345-0@lo:400:kworker.0 Request processed in 41us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940517.870545:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788940517.870581:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875839738271488:0@lo:400:kworker.0 00000100:00100000:0.0:1788940517.870590:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875839738271360:0@lo:400:kworker.0 00000100:00080000:0.0:1788940517.870618:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788940517.870621:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788940517.870638:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875839738271616:0@lo:400:kworker.0 00000100:00100000:0.0:1788940517.870647:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f198182d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3306:1875839738271232:0@lo:400:kworker.0 00000100:00100000:0.0:1788940517.870655:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1788940517.870660:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:0.0:1788940517.870674:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89f1b55c3b80, transno 4294967310 00000100:00100000:0.0:1788940517.870685:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b500f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738271744:0@lo:400:kworker.0 00000100:00100000:2.0:1788940517.871651:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4c26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738271104:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1788940517.933842:0:12648:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788940517.933851:0:12648:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788940517.933915:0:12648:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788940517.933923:0:12648:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788940518.060855:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940518.261472:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940518.261643:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718363008 00000100:00100000:2.0:1788940518.261657:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718363008 00000100:00100000:2.0:1788940518.261750:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 236 00000100:00100000:2.0:1788940518.261763:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b500f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+29:11662:x1875839718363008:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:2.0:1788940518.261789:0:7857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940518.261810:0:7857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4ba7d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5b0f expref: -99 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940518.261918:0:7857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4ba84 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940518.261935:0:7857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4ba84 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940518.261949:0:7857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4ba84 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940518.261976:0:7857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788940518.262160:0:7857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa600/0x27a633fcdd4ba7d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5b0f expref: 32 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940518.262200:0:7857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4ba84 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5b0f expref: 31 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940518.262212:0:7857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89f186946600) 00010000:00010000:2.0:1788940518.262216:0:7857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788940518.262221:0:7857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f188daaa00, rc 0) 00000100:00080000:0.0:1788940518.262340:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940518.266558:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b500f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+31:11662:x1875839718363008:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 4751us (5047us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1788940518.266574:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 236 00000100:00100000:0.0:1788940518.271999:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940518.272053:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718363136 00000100:00100000:0.0:1788940518.272066:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718363136 00000100:00100000:0.0:1788940518.272136:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 237 00000100:00100000:0.0:1788940518.272148:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf580000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+31:11662:x1875839718363136:12345-192.168.202.14@tcp:54:lfs.0 00010000:00010000:0.0:1788940518.272236:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4ba92 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940518.272255:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4ba92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940518.272268:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4ba92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940518.272295:0:5860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4ba92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940518.272301:0:5860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4ba92 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940518.272317:0:5860:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4ba92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940518.272323:0:5860:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad3800 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:0.0:1788940518.272328:0:5860:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4ba92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940518.272336:0:5860:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4ba92 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940518.272348:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89f186946600) 00010000:00010000:0.0:1788940518.272351:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788940518.272357:0:5860:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4ba92 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940518.272365:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4ba92 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940518.272442:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf580000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+31:11662:x1875839718363136:12345-192.168.202.14@tcp:54:lfs.0 Request processed in 295us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940518.272450:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 237 00000100:00100000:1.0:1788940518.542998:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940518.543114:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718363264 00000100:00100000:2.0:1788940518.543126:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718363264 00000100:00100000:2.0:1788940518.543202:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 71 00000100:00100000:2.0:1788940518.543214:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4c26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+7:2352:x1875839718363264:12345-192.168.202.14@tcp:101:cat.0 00010000:00010000:2.0:1788940518.543236:0:6708:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940518.543259:0:6708:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a5e6d01/0x27a633fcdd4ba99 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5b16 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788940518.543300:0:6708:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6aa110e3, atime: 0x6aa110e2, ctime: 0x6aa110e3, blocks: 0xb 00010000:00010000:2.0:1788940518.543323:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1788940518.543328:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940518.543338:0:6708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a5e6d01/0x27a633fcdd4ba99 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5b16 expref: 8 pid: 6708 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940518.543382:0:6708:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000a5e6d01/0x27a633fcdd4ba99 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5b16 expref: 8 pid: 6708 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940518.543398:0:6708:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f188daa600, rc 0) 00000100:00100000:2.0:1788940518.543465:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4c26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+8:2352:x1875839718363264:12345-192.168.202.14@tcp:101:cat.0 Request processed in 254us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940518.543473:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 71 00000100:00100000:0.0:1788940518.550614:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940518.551356:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718363392 00000100:00100000:3.0:1788940518.551369:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718363392 00002000:00100000:3.0:1788940518.551424:0:6711:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff89f198182d80 x1875839718363392/t0(0) o3->9c51ff78-d02d-4e61-8a10-a2f8830f1679@192.168.202.14@tcp:494/0 lens 488/0 e 0 to 0 dl 1788940529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788940518.551435:0:6711:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89f198182d80 with x1875839718363392 ext(0->4095) 00002000:00010000:3.0:1788940518.551441:0:6711:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89f198182d80 00000100:00100000:3.0:1788940518.551480:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 7 00000100:00100000:3.0:1788940518.551490:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f198182d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+8:2353:x1875839718363392:12345-192.168.202.14@tcp:3:cat.0 00000100:00100000:3.0:1788940518.553348:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f198182d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+8:2353:x1875839718363392:12345-192.168.202.14@tcp:3:cat.0 Request processed in 1848us (2734us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788940518.553362:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 7 00002000:00100000:3.0:1788940518.553375:0:6711:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff89f198182d80 x1875839718363392/t0(0) o3->9c51ff78-d02d-4e61-8a10-a2f8830f1679@192.168.202.14@tcp:494/0 lens 488/4536 e 0 to 0 dl 1788940529 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788940518.553385:0:6711:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89f198182d80 with x1875839718363392 ext(0->4095) 00002000:00010000:3.0:1788940518.553391:0:6711:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89f198182d80 00010000:00010000:2.0:1788940519.084957:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940519.405004:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4c26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738271872:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788940519.405088:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940519.408302:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738271872 00000100:00100000:2.0:1788940519.408319:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738271872 00000100:00100000:2.0:1788940519.408422:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788940519.408436:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f198181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738271872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788940519.408481:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788940519.408647:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788940519.409000:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f198181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738271872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 567us (3909us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940519.409009:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788940519.415430:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4c26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738271872:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1788940520.010219:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:2.0:1788940520.010238:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:1.0:1788940520.052504:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000001:00080000:1.0:1788940520.052537:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967516 is committed 00000020:00080000:1.0:1788940520.052547:0:5883:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89f187c03480 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1788940520.052552:0:5883:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89f1bf9c5e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89f187c03840 00000020:00080000:1.0:1788940520.052556:0:5883:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89f1bf9c5300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89f1b48f1000 00000001:00080000:1.0:1788940520.052570:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:2.0:1788940520.052576:0:5894:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 5 00000020:00080000:1.0:1788940520.052588:0:5883:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:1.0:1788940520.052591:0:5883:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 6 batchid updated 00000020:00080000:2.0:1788940520.052815:0:5894:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:0.0:1788940520.113975:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788940521.133270:0:11708:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788940521.133281:0:11708:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788940521.133320:0:11708:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788940521.133342:0:11708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788940521.141391:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940522.157181:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940522.511390:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940522.511498:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940522.511854:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940522.512217:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940522.512322:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940522.512439:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718363520 00000100:00100000:2.0:1788940522.512452:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718363520 00000100:00100000:1.0:1788940522.512751:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718363648 00000100:00100000:1.0:1788940522.512767:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718363648 00000100:00100000:1.0:1788940522.512841:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718364032 00000100:00100000:1.0:1788940522.512845:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718364032 00000100:00100000:1.0:1788940522.512876:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 188 00000100:00100000:3.0:1788940522.512882:0:7074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718363904 00000100:00100000:1.0:1788940522.512899:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5625180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+18:2352:x1875839718363648:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788940522.513001:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5625180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+18:2352:x1875839718363648:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 108us (1636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940522.513008:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 188 00000100:00100000:1.0:1788940522.513042:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 189 00000100:00100000:3.0:1788940522.513049:0:7074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718363904 00000100:00100000:1.0:1788940522.513053:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf97dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffa310cd-169f-42e3-8999-506116bada08+5:2352:x1875839718364032:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788940522.513083:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf97dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffa310cd-169f-42e3-8999-506116bada08+5:2352:x1875839718364032:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 33us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940522.513089:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 189 00000100:00080000:1.0:1788940522.513112:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788940522.513291:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788940522.515578:0:7074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718363776 00000100:00100000:3.0:1788940522.515787:0:7074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718363776 00000100:00100000:3.0:1788940522.515926:0:7074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 105 00000100:00100000:3.0:1788940522.515957:0:7074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf97d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+5:2352:x1875839718363904:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788940522.516191:0:7074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf97d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+5:2352:x1875839718363904:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 225us (4677us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940522.516247:0:7074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 105 00000100:00100000:3.0:1788940522.516321:0:7074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 106 00000100:00100000:3.0:1788940522.516343:0:7074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf97ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+7:2352:x1875839718363776:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788940522.516454:0:7074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf97ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+7:2352:x1875839718363776:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 110us (4241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940522.516462:0:7074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 106 00000100:00080000:1.0:1788940522.516766:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788940522.525028:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 313 00000100:00100000:2.0:1788940522.525197:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18416c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:2352:x1875839718363520:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788940522.526501:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18416c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:2352:x1875839718363520:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 1321us (14663us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940522.526575:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 313 00000100:00100000:1.0:1788940522.990765:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bfbec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875839738272256:0@lo:400:kworker.0 00000100:00100000:1.0:1788940522.990840:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940522.990905:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788940522.990912:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bfbed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875839738272128:0@lo:400:kworker.0 00000100:00100000:1.0:1788940522.990935:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940522.990951:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bfbef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738272640:0@lo:400:kworker.0 00000100:00100000:3.0:1788940522.991377:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738272256 00000100:00100000:3.0:1788940522.991388:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738272256 00000100:00100000:3.0:1788940522.991449:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738272128 00000100:00100000:1.0:1788940522.991573:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940522.991619:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1788940522.991630:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875839738272256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940522.991690:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875839738272256:12345-0@lo:400:kworker.0 Request processed in 62us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940522.991698:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00080000:1.0:1788940522.991728:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940522.991763:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bfbec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875839738272256:0@lo:400:kworker.0 00000100:00100000:2.0:1788940522.991985:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738272640 00000100:00100000:2.0:1788940522.991989:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738272640 00000100:00100000:2.0:1788940522.992028:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788940522.992035:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738272640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940522.992078:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738272640:12345-0@lo:400:kworker.0 Request processed in 43us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940522.992085:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:1.0:1788940522.992266:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788940522.992277:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bfbec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738272768:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788940522.992307:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940522.992343:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bfbef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738272640:0@lo:400:kworker.0 00000100:00100000:3.0:1788940522.992760:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738272128 00000100:00100000:3.0:1788940522.992794:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788940522.992802:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875839738272128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940522.992896:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875839738272128:12345-0@lo:400:kworker.0 Request processed in 95us (1960us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940522.992903:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788940522.993040:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bfbed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875839738272128:0@lo:400:kworker.0 00000100:00100000:0.0:1788940522.995073:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4c26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3308:1875839738272000:0@lo:400:kworker.0 00000100:00100000:0.0:1788940522.995169:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940522.995251:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bfbeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875839738272512:0@lo:400:kworker.0 00000100:00100000:0.0:1788940522.995284:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940522.995317:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788940522.995324:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bfbedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738272384:0@lo:400:kworker.0 00000100:00100000:0.0:1788940522.995349:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940522.995435:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738272512 00000100:00100000:0.0:1788940522.995445:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738272512 00000100:00100000:0.0:1788940522.995509:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1788940522.995549:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875839738272512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940522.995607:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875839738272512:12345-0@lo:400:kworker.0 Request processed in 90us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940522.995615:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1788940522.995654:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bfbeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875839738272512:0@lo:400:kworker.0 00000100:00080000:0.0:1788940522.995684:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940522.995838:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738272768 00000100:00100000:1.0:1788940522.995843:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738272768 00000100:00100000:1.0:1788940522.995895:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788940522.995903:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738272768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788940522.995937:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788940523.000485:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738272768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4574us (8169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940523.000500:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788940523.000793:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738272000 00000100:00100000:3.0:1788940523.000805:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738272000 00000100:00100000:3.0:1788940523.000855:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1788940523.000865:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18416e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3308:x1875839738272000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940523.000974:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18416e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3308:x1875839738272000:12345-0@lo:400:kworker.0 Request processed in 111us (5806us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940523.000982:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1788940523.001032:0:12095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738272384 00000100:00100000:3.0:1788940523.001037:0:12095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738272384 00000100:00100000:3.0:1788940523.001083:0:12095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788940523.001090:0:12095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738272384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940523.001127:0:12095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738272384:12345-0@lo:400:kworker.0 Request processed in 38us (5778us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940523.001133:0:12095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788940523.001185:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:3.0:1788940523.001192:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:3.0:1788940523.001216:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bfbedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738272384:0@lo:400:kworker.0 00000100:00100000:3.0:1788940523.001228:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4c26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3308:1875839738272000:0@lo:400:kworker.0 00000100:00100000:3.0:1788940523.001268:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bfbec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738272768:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788940523.001815:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788940523.184806:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940524.209557:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940524.524724:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788940524.524747:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f083eddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738272896:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788940524.524821:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940524.526285:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738272896 00000100:00100000:2.0:1788940524.526297:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738272896 00000100:00100000:2.0:1788940524.526376:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788940524.526388:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f083edca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738272896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788940524.526434:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788940524.526513:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f083edca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738272896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (1691us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940524.526540:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:0.0:1788940524.527699:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788940524.527757:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f083eddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738272896:0@lo:13:osp-pre-1-0.0 00000020:00080000:0.0:1788940525.147402:0:5883:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1788940525.149408:0:5894:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1788940525.149430:0:5894:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:0.0:1788940525.229949:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940525.824012:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940525.824741:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718364160 00000100:00100000:3.0:1788940525.824757:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718364160 00000100:00100000:3.0:1788940525.824866:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 238 00000100:00100000:3.0:1788940525.824880:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+18:11315:x1875839718364160:12345-192.168.202.14@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788940525.825014:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+18:11315:x1875839718364160:12345-192.168.202.14@tcp:60:lhsmtool_posix.0 Request processed in 137us (1020us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940525.825022:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 238 00000100:00080000:0.0:1788940525.826504:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940525.829465:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940525.829981:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718364416 00000100:00100000:3.0:1788940525.829995:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718364416 00000100:00100000:3.0:1788940525.830065:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 65 00000100:00100000:3.0:1788940525.830076:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+18:11315:x1875839718364416:12345-192.168.202.14@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788940525.832175:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+19:11315:x1875839718364416:12345-192.168.202.14@tcp:35:lhsmtool_posix.0 Request processed in 2092us (2712us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1788940525.832189:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 65 00000100:00100000:3.0:1788940526.162580:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940526.162687:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718364544 00000100:00100000:0.0:1788940526.162699:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718364544 00000100:00100000:0.0:1788940526.162782:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 239 00000100:00100000:0.0:1788940526.162795:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b55c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffa310cd-169f-42e3-8999-506116bada08+5:12113:x1875839718364544:12345-192.168.202.14@tcp:101:lsof.0 00010000:00010000:0.0:1788940526.162846:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940526.162870:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4baa0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5b1d expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940526.162938:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4baa7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940526.162953:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4baa7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940526.162966:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4baa7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940526.163013:0:5860:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788940526.163017:0:5860:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788940526.163042:0:5860:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4baa7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940526.163067:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4baa0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5b1d expref: 7 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940526.163087:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4baa7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5b1d expref: 6 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940526.163095:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f186946e00) 00010000:00010000:0.0:1788940526.163098:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788940526.163102:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f082ad2600, rc 0) 00000100:00100000:0.0:1788940526.163174:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b55c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffa310cd-169f-42e3-8999-506116bada08+6:12113:x1875839718364544:12345-192.168.202.14@tcp:101:lsof.0 Request processed in 381us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940526.163182:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 239 00000100:00080000:1.0:1788940526.164062:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788940526.255439:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940527.277467:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940527.616004:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940527.616048:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940527.616082:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940527.616119:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940527.616142:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940527.616169:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718365184 00000100:00100000:1.0:1788940527.616181:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718365184 00000100:00100000:1.0:1788940527.616239:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718364800 00000100:00100000:1.0:1788940527.616242:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718364800 00000100:00100000:1.0:1788940527.616273:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 193 00000100:00100000:1.0:1788940527.616284:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffa310cd-169f-42e3-8999-506116bada08+6:2352:x1875839718365184:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788940527.616367:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffa310cd-169f-42e3-8999-506116bada08+6:2352:x1875839718365184:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 85us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940527.616375:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 193 00000100:00100000:1.0:1788940527.616394:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 194 00000100:00100000:1.0:1788940527.616401:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+19:2352:x1875839718364800:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788940527.616437:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+19:2352:x1875839718364800:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 37us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940527.616442:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 194 00000100:00100000:1.0:1788940527.616480:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718364928 00000100:00100000:1.0:1788940527.616484:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718364928 00000100:00100000:1.0:1788940527.616510:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718365056 00000100:00100000:1.0:1788940527.616512:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718365056 00000100:00100000:1.0:1788940527.616946:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 109 00000100:00100000:1.0:1788940527.616954:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+7:2352:x1875839718364928:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788940527.616986:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+7:2352:x1875839718364928:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 34us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940527.617012:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 109 00000100:00100000:1.0:1788940527.617024:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 110 00000100:00100000:1.0:1788940527.617030:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+5:2352:x1875839718365056:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788940527.617055:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+5:2352:x1875839718365056:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 25us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940527.617061:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 110 00000100:00080000:1.0:1788940527.617090:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788940527.617105:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788940527.617108:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940527.617393:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718364672 00000100:00100000:2.0:1788940527.617399:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718364672 00000100:00100000:2.0:1788940527.617442:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 315 00000100:00100000:2.0:1788940527.617460:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18416c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:2352:x1875839718364672:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788940527.617510:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18416c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:2352:x1875839718364672:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 61us (1517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940527.617540:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 315 00000100:00100000:0.0:1788940528.109040:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bfbed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738273024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788940528.109132:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940528.109355:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f184195180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875839738273536:0@lo:400:kworker.0 00000100:00100000:2.0:1788940528.109389:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940528.109410:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788940528.109415:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f184194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875839738273408:0@lo:400:kworker.0 00000100:00100000:2.0:1788940528.109437:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940528.109540:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ba977b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3305:1875839738273152:0@lo:400:kworker.0 00000100:00100000:0.0:1788940528.109574:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940528.109616:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5833800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738273664:0@lo:400:kworker.0 00000100:00100000:0.0:1788940528.109641:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940528.109672:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788940528.109677:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ba974000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875839738273280:0@lo:400:kworker.0 00000100:00100000:0.0:1788940528.109698:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940528.109963:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738273152 00000100:00100000:2.0:1788940528.109977:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738273152 00000100:00100000:2.0:1788940528.110041:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1788940528.110052:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18416e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3305:x1875839738273152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940528.110123:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18416e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3305:x1875839738273152:12345-0@lo:400:kworker.0 Request processed in 72us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940528.110132:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1788940528.110183:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ba977b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3305:1875839738273152:0@lo:400:kworker.0 00000100:00100000:1.0:1788940528.110365:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738273024 00000100:00100000:1.0:1788940528.110371:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738273024 00000100:00100000:1.0:1788940528.110424:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788940528.110431:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f083eddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738273024:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788940528.110566:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738273536 00000100:00100000:0.0:1788940528.110570:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738273536 00000100:00100000:0.0:1788940528.110621:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738273408 00000100:00100000:0.0:1788940528.110625:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738273408 00000100:00100000:0.0:1788940528.110640:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738273280 00000100:00100000:0.0:1788940528.110652:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738273280 00000100:00100000:0.0:1788940528.110669:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1788940528.110675:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5830e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875839738273536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940528.110720:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5830e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875839738273536:12345-0@lo:400:kworker.0 Request processed in 45us (1330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940528.110727:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1788940528.110742:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1788940528.110749:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875839738273408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940528.110777:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875839738273408:12345-0@lo:400:kworker.0 Request processed in 29us (1339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940528.110782:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1788940528.110795:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788940528.110801:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f083edf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875839738273280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940528.110851:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f083edf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875839738273280:12345-0@lo:400:kworker.0 Request processed in 50us (1151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940528.110857:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788940528.110888:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738273664 00000100:00100000:0.0:1788940528.110892:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738273664 00000100:00100000:0.0:1788940528.110923:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788940528.110929:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f083edf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738273664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940528.110960:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f083edf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738273664:12345-0@lo:400:kworker.0 Request processed in 31us (1318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940528.110966:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00002000:00000024:1.0:1788940528.111335:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788940528.111377:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f083eddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738273024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 946us (2245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940528.111385:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:2.0:1788940528.111456:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788940528.111461:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788940528.111463:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788940528.111495:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ba974000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875839738273280:0@lo:400:kworker.0 00000100:00100000:2.0:1788940528.111507:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5833800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738273664:0@lo:400:kworker.0 00000100:00100000:2.0:1788940528.111576:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f184194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875839738273408:0@lo:400:kworker.0 00000100:00100000:2.0:1788940528.111598:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f184195180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875839738273536:0@lo:400:kworker.0 00000100:00100000:2.0:1788940528.111616:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bfbed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738273024:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788940528.301286:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940529.324953:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940529.648348:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f083edfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738273792:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788940529.648431:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940529.649571:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738273792 00000100:00100000:0.0:1788940529.649585:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738273792 00000100:00100000:0.0:1788940529.649667:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788940529.649679:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b55c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738273792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788940529.649723:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788940529.649801:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b55c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738273792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (1369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940529.649808:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788940529.650178:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f083edfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738273792:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1788940530.262886:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00010000:00010000:0.0:1788940530.352360:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788940531.372727:0:11708:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788940531.372736:0:11708:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788940531.373257:0:11708:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1788940531.373282:0:11708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788940531.374020:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788940532.299817:0:12852:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 03:55:31 (1788940531) 00010000:00010000:3.0:1788940532.397220:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940532.740080:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940532.740180:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940532.740207:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940532.740224:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940532.740267:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940532.740298:0:7074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718365568 00000100:00100000:1.0:1788940532.740311:0:7074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718365568 00000100:00100000:1.0:1788940532.740401:0:7074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718365696 00000100:00100000:1.0:1788940532.740405:0:7074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718365696 00000100:00100000:1.0:1788940532.740430:0:7074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 112 00000100:00100000:1.0:1788940532.740441:0:7074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+7:2353:x1875839718365568:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788940532.740534:0:7074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+7:2353:x1875839718365568:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 77us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940532.740541:0:7074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 112 00000100:00100000:1.0:1788940532.740557:0:7074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 113 00000100:00100000:1.0:1788940532.740565:0:7074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+5:2353:x1875839718365696:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788940532.740590:0:7074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c51ff78-d02d-4e61-8a10-a2f8830f1679+5:2353:x1875839718365696:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 26us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940532.740595:0:7074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 113 00000100:00100000:1.0:1788940532.740624:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718365824 00000100:00080000:2.0:1788940532.740738:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788940532.740743:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788940532.740841:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718365824 00000100:00100000:1.0:1788940532.740889:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718365440 00000100:00100000:1.0:1788940532.740893:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718365440 00000100:00100000:1.0:1788940532.740914:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 198 00000100:00100000:1.0:1788940532.740921:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffa310cd-169f-42e3-8999-506116bada08+6:2353:x1875839718365824:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788940532.741160:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffa310cd-169f-42e3-8999-506116bada08+6:2353:x1875839718365824:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 238us (951us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940532.741167:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 198 00000100:00100000:1.0:1788940532.741180:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 199 00000100:00100000:1.0:1788940532.741186:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+18:2353:x1875839718365440:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788940532.741224:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+18:2353:x1875839718365440:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 38us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940532.741230:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 199 00000100:00080000:2.0:1788940532.741556:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788940532.742028:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718365312 00000100:00100000:3.0:1788940532.742035:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718365312 00000100:00100000:3.0:1788940532.742119:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 317 00000100:00100000:3.0:1788940532.742128:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18416fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:2353:x1875839718365312:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788940532.742174:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18416fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:2353:x1875839718365312:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 47us (2104us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940532.742180:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 317 00000100:00100000:1.0:1788940533.230274:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788940533.230307:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bfbec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738273920:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788940533.230382:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940533.238852:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738273920 00000100:00100000:0.0:1788940533.238864:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738273920 00000100:00100000:0.0:1788940533.238935:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788940533.238947:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738273920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788940533.238991:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788940533.239085:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738273920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 141us (8702us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940533.239093:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788940533.239134:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f083edea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875839738274176:0@lo:400:kworker.0 00000100:00100000:0.0:1788940533.239174:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940533.239215:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788940533.239221:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f083ede300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875839738274304:0@lo:400:kworker.0 00000100:00100000:0.0:1788940533.239244:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788940533.239275:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788940533.239291:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738274176 00000100:00100000:0.0:1788940533.239296:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738274176 00000100:00100000:0.0:1788940533.239324:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738274304 00000100:00100000:0.0:1788940533.239327:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738274304 00000100:00100000:0.0:1788940533.239349:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1788940533.239355:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f083edc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875839738274176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940533.239393:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f083edc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875839738274176:12345-0@lo:400:kworker.0 Request processed in 38us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940533.239399:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1788940533.239412:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788940533.239417:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f083edd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875839738274304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940533.239443:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f083edd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875839738274304:12345-0@lo:400:kworker.0 Request processed in 26us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940533.239448:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00080000:0.0:1788940533.239470:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788940533.239842:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f083edce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875839738274432:0@lo:400:kworker.0 00000100:00100000:3.0:1788940533.239879:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940533.239907:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788940533.239913:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f083eded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3307:1875839738274048:0@lo:400:kworker.0 00000100:00100000:3.0:1788940533.239941:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940533.239962:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f083ede680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738274560:0@lo:400:kworker.0 00000100:00100000:3.0:1788940533.239985:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940533.240015:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738274432 00000100:00100000:3.0:1788940533.240020:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738274432 00000100:00100000:3.0:1788940533.240064:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1788940533.240082:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b55c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875839738274432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940533.240121:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b55c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875839738274432:12345-0@lo:400:kworker.0 Request processed in 40us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940533.240127:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1788940533.240147:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738274048 00000100:00100000:3.0:1788940533.240151:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738274048 00000100:00100000:3.0:1788940533.240175:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1788940533.240182:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18416d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3307:x1875839738274048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940533.240212:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18416d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3307:x1875839738274048:12345-0@lo:400:kworker.0 Request processed in 31us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940533.240218:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1788940533.240245:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738274560 00000100:00100000:3.0:1788940533.240248:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738274560 00000100:00100000:3.0:1788940533.240272:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788940533.240290:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b55c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738274560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940533.240317:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b55c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738274560:12345-0@lo:400:kworker.0 Request processed in 40us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940533.240322:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:3.0:1788940533.240336:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788940533.240339:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788940533.240358:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f083eded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3307:1875839738274048:0@lo:400:kworker.0 00000100:00100000:3.0:1788940533.240370:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f083ede680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738274560:0@lo:400:kworker.0 00000100:00100000:3.0:1788940533.240378:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f083edce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875839738274432:0@lo:400:kworker.0 00000100:00100000:1.0:1788940533.240586:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bfbec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738273920:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788940533.240745:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f083ede300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875839738274304:0@lo:400:kworker.0 00000100:00100000:0.0:1788940533.240761:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f083edea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875839738274176:0@lo:400:kworker.0 00010000:00010000:1.0:1788940533.420727:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940534.446205:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940534.764903:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f083edea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738274688:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788940534.764979:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940534.765206:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738274688 00000100:00100000:3.0:1788940534.765216:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738274688 00000100:00100000:3.0:1788940534.765288:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788940534.765315:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738274688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788940534.765357:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788940534.770226:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738274688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4901us (5235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940534.770243:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788940534.775590:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f083edea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738274688:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788940535.468959:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940536.492787:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940536.995365:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940536.995480:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718366080 00000100:00100000:2.0:1788940536.995492:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718366080 00000100:00100000:2.0:1788940536.995627:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 66 00000100:00100000:2.0:1788940536.995641:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+18:12335:x1875839718366080:12345-192.168.202.14@tcp:35:umount.0 00000100:00100000:2.0:1788940536.996031:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+19:12335:x1875839718366080:12345-192.168.202.14@tcp:35:umount.0 Request processed in 392us (675us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1788940536.996040:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 66 00000100:00080000:3.0:1788940536.999502:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940536.999668:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940536.999792:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718366336 00000100:00100000:2.0:1788940536.999803:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718366336 00000100:00100000:2.0:1788940536.999865:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 67 00000100:00100000:2.0:1788940536.999877:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+19:12335:x1875839718366336:12345-192.168.202.14@tcp:35:umount.0 00000100:00100000:2.0:1788940537.000363:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c51ff78-d02d-4e61-8a10-a2f8830f1679+20:12335:x1875839718366336:12345-192.168.202.14@tcp:35:umount.0 Request processed in 486us (698us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1788940537.000371:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 67 00000100:00100000:0.0:1788940537.005035:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940537.005266:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718366592 00000100:00100000:1.0:1788940537.005279:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718366592 00000100:00100000:1.0:1788940537.005347:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 68 00000100:00100000:1.0:1788940537.005359:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b05cd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+20:12335:x1875839718366592:12345-192.168.202.14@tcp:35:umount.0 00000100:00100000:1.0:1788940537.005644:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b05cd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+21:12335:x1875839718366592:12345-192.168.202.14@tcp:35:umount.0 Request processed in 287us (615us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1788940537.005660:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 68 00000100:00100000:1.0:1788940537.010031:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940537.010267:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718366848 00000100:00100000:0.0:1788940537.010293:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718366848 00000100:00100000:0.0:1788940537.010407:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 69 00000100:00100000:0.0:1788940537.010419:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+21:12335:x1875839718366848:12345-192.168.202.14@tcp:35:umount.0 00000100:00100000:0.0:1788940537.010826:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+22:12335:x1875839718366848:12345-192.168.202.14@tcp:35:umount.0 Request processed in 408us (805us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1788940537.010834:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 69 00000100:00100000:3.0:1788940537.014709:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940537.014751:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940537.014880:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718366976 00000100:00100000:1.0:1788940537.014890:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718366976 00000100:00100000:1.0:1788940537.014941:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718367104 00000100:00100000:1.0:1788940537.014943:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718367104 00000100:00100000:1.0:1788940537.014979:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 19 00000100:00100000:1.0:1788940537.014989:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b55c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0b05a86-29c8-44a6-9c64-75d9d650043e+14:2351:x1875839718366976:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788940537.015026:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940537.015045:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f181520800/0x27a633fcdd4aa85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5670 expref: 14 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940537.015062:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940537.015110:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b55c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0b05a86-29c8-44a6-9c64-75d9d650043e+13:2351:x1875839718366976:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 123us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940537.015117:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 19 00000100:00100000:1.0:1788940537.015136:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 20 00000100:00100000:1.0:1788940537.015142:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b55c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0b05a86-29c8-44a6-9c64-75d9d650043e+12:2351:x1875839718367104:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788940537.015151:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940537.015160:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f19258de00/0x27a633fcdd4ad33 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5773 expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940537.015168:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940537.015185:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b55c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0b05a86-29c8-44a6-9c64-75d9d650043e+11:2351:x1875839718367104:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 44us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940537.015192:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 20 00000100:00100000:1.0:1788940537.020408:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940537.020442:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940537.020477:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718367360 00000100:00100000:1.0:1788940537.020495:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718367360 00000100:00100000:1.0:1788940537.020582:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 21 00000100:00100000:1.0:1788940537.020591:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0b05a86-29c8-44a6-9c64-75d9d650043e+11:2350:x1875839718367360:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788940537.020606:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940537.020636:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f1829dae00/0x27a633fcdd4ab1f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f56a8 expref: 11 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940537.020652:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940537.020695:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0b05a86-29c8-44a6-9c64-75d9d650043e+10:2350:x1875839718367360:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 106us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940537.020700:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 21 00000100:00100000:3.0:1788940537.021012:0:12095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718367232 00000100:00100000:3.0:1788940537.021018:0:12095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718367232 00000100:00100000:3.0:1788940537.021066:0:12095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 72 00000100:00100000:3.0:1788940537.021074:0:12095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9c51ff78-d02d-4e61-8a10-a2f8830f1679+5:2349:x1875839718367232:12345-192.168.202.14@tcp:9:umount.0 00000020:00000080:3.0:1788940537.021101:0:12095:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x27a633fcdd4adf7 00000100:00080000:3.0:1788940537.021111:0:12095:0:(import.c:65:import_set_state_nolock()) ffff89f1bf722800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788940537.021149:0:12095:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1788940537.021389:0:12095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9c51ff78-d02d-4e61-8a10-a2f8830f1679+2:2349:x1875839718367232:12345-192.168.202.14@tcp:9:umount.0 Request processed in 315us (990us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940537.021394:0:12095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 72 00010000:00010000:3.0:1788940537.021413:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788940537.021977:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788940537.027274:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940537.027375:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718367744 00000100:00100000:0.0:1788940537.027386:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718367744 00000100:00100000:0.0:1788940537.027446:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 73 00000100:00100000:0.0:1788940537.027460:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1baad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+7:2349:x1875839718367744:12345-192.168.202.14@tcp:9:umount.0 00000020:00000080:0.0:1788940537.027503:0:6707:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x27a633fcdd4b05f 00000020:00010000:0.0:1788940537.027511:0:6707:0:(genops.c:1929:obd_stale_export_put()) Put export ffff89f1b8970000: total 0 00000100:00080000:0.0:1788940537.027550:0:6707:0:(import.c:65:import_set_state_nolock()) ffff89f1b8975000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788940537.027585:0:6707:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00080000:1.0:1788940537.027873:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788940537.028150:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1baad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c51ff78-d02d-4e61-8a10-a2f8830f1679+5:2349:x1875839718367744:12345-192.168.202.14@tcp:9:umount.0 Request processed in 694us (882us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940537.028160:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 73 00000020:00010000:2.0:1788940537.033193:0:7648:0:(genops.c:1915:obd_stale_export_get()) Get export ffff89f1b8970000: total 0 00010000:00010000:2.0:1788940537.033291:0:7648:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff89f1b8970000, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1788940537.033365:0:7648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a5e6d01/0x27a633fcdd4ba99 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5b16 expref: 4 pid: 6708 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940537.033406:0:7648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c74d2b5e/0x27a633fcdd4b3fb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5948 expref: 3 pid: 12095 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940537.033447:0:7648:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff89f1b8970000, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1788940537.033460:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940537.033462:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940537.033464:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940537.045577:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940537.045664:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718368768 00000100:00100000:0.0:1788940537.045677:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718368768 00000100:00100000:0.0:1788940537.045758:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 240 00000100:00100000:0.0:1788940537.045767:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b55c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+22:2349:x1875839718368768:12345-192.168.202.14@tcp:39:umount.0 00000020:00000080:0.0:1788940537.045802:0:5862:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x27a633fcdd4aa93 00000020:00010000:0.0:1788940537.045817:0:5862:0:(genops.c:1929:obd_stale_export_put()) Put export ffff89f1ae71e800: total 0 00000100:00080000:0.0:1788940537.045821:0:5862:0:(import.c:65:import_set_state_nolock()) ffff89f1ae71a800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788940537.045845:0:5862:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:0.0:1788940537.046199:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b55c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c51ff78-d02d-4e61-8a10-a2f8830f1679+21:2349:x1875839718368768:12345-192.168.202.14@tcp:39:umount.0 Request processed in 431us (722us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1788940537.046227:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 240 00000020:00010000:3.0:1788940537.046604:0:5848:0:(genops.c:1915:obd_stale_export_get()) Get export ffff89f1ae71e800: total 0 00010000:00010000:3.0:1788940537.046640:0:5848:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff89f1ae71e800, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1788940537.046676:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89f188f81400) 00010000:00010000:3.0:1788940537.046680:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788940537.046689:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4b2dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f58fb expref: 20 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940537.046717:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89f186946600) 00010000:00010000:3.0:1788940537.046719:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788940537.046722:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab400/0x27a633fcdd4ba5a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5b01 expref: 19 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940537.046730:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f186946e00) 00010000:00010000:3.0:1788940537.046732:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788940537.046734:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daae00/0x27a633fcdd4b45d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5964 expref: 18 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940537.046742:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89f186946200) 00010000:00010000:3.0:1788940537.046743:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940537.046745:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188dab000/0x27a633fcdd4ad79 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5788 expref: 17 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940537.046756:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89f188f81400) 00010000:00010000:3.0:1788940537.046758:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788940537.046760:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180030c00/0x27a633fcdd4b3bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5933 expref: 16 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940537.046768:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89f186946600) 00010000:00010000:3.0:1788940537.046769:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788940537.046771:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daaa00/0x27a633fcdd4ba84 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5b0f expref: 15 pid: 7857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940537.046777:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff89f188f81800) 00010000:00010000:3.0:1788940537.046778:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788940537.046785:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d200/0x27a633fcdd4ad5d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5781 expref: 14 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940537.046795:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89f188f81400) 00010000:00010000:3.0:1788940537.046797:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788940537.046799:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f188daa800/0x27a633fcdd4b3e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5941 expref: 13 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940537.046809:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89f1983af600) 00010000:00010000:3.0:1788940537.046810:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788940537.046812:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3200/0x27a633fcdd4b479 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f596b expref: 12 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940537.046819:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89f1983af600) 00010000:00010000:3.0:1788940537.046820:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788940537.046822:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c400/0x27a633fcdd4b758 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5a3d expref: 11 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940537.046831:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89f188f81300) 00010000:00010000:3.0:1788940537.046832:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788940537.046834:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ca00/0x27a633fcdd4adcd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f579d expref: 10 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940537.046841:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89f186946600) 00010000:00010000:3.0:1788940537.046842:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788940537.046844:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97e00/0x27a633fcdd4b97a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5ac9 expref: 9 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940537.046854:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89f188f81300) 00010000:00010000:3.0:1788940537.046858:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788940537.046861:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f180031a00/0x27a633fcdd4b0ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f586f expref: 8 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940537.046871:0:5848:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff89f1ae71e800, canceled 13 locks, left on hash table 0. 00010000:00010000:3.0:1788940537.046879:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940537.046881:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940537.046882:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940537.517258:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940537.853961:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940537.854012:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940537.854563:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718369024 00000100:00100000:3.0:1788940537.854575:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718369024 00000100:00100000:3.0:1788940537.854660:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 203 00000100:00100000:3.0:1788940537.854673:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1baad6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffa310cd-169f-42e3-8999-506116bada08+6:2352:x1875839718369024:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788940537.854740:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1baad6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffa310cd-169f-42e3-8999-506116bada08+6:2352:x1875839718369024:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 71us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940537.854746:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 203 00000100:00100000:0.0:1788940537.855087:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718368896 00000100:00100000:0.0:1788940537.855093:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718368896 00000100:00100000:0.0:1788940537.855308:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 319 00000100:00100000:0.0:1788940537.855318:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f18416cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0b05a86-29c8-44a6-9c64-75d9d650043e+10:2352:x1875839718368896:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788940537.855356:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f18416cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0b05a86-29c8-44a6-9c64-75d9d650043e+10:2352:x1875839718368896:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 40us (1405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940537.855362:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 319 00000100:00080000:1.0:1788940537.856015:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:1.0:1788940537.889960:0:7662:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9c51ff78-d02d-4e61-8a10-a2f8830f1679 00000020:00000080:1.0:1788940537.889969:0:7662:0:(genops.c:893:class_export_put()) final put ffff89f0841e5800/9c51ff78-d02d-4e61-8a10-a2f8830f1679 00000020:00000080:3.0:1788940537.890066:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffff89f0841e5800/9c51ff78-d02d-4e61-8a10-a2f8830f1679 for lustre-OST0001 00000020:00000080:3.0:1788940537.890129:0:36:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff89f1bf722800 for lustre-OST0001 00000100:00100000:2.0:1788940538.349752:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1baad4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738275200:0@lo:400:kworker.0 00000100:00100000:1.0:1788940538.349757:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1baad5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875839738275072:0@lo:400:kworker.0 00000100:00100000:0.0:1788940538.349814:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1baad4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3306:1875839738274816:0@lo:400:kworker.0 00000100:00100000:2.0:1788940538.349829:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940538.349851:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940538.349917:0:7074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738275200 00000100:00100000:2.0:1788940538.349927:0:7074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738275200 00000100:00100000:2.0:1788940538.349989:0:7074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788940538.350137:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940538.350160:0:7074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5833800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738275200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940538.350160:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788940538.350166:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1baad5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875839738274944:0@lo:400:kworker.0 00000100:00100000:1.0:1788940538.350188:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940538.350205:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1baad5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738275456:0@lo:400:kworker.0 00000100:00100000:1.0:1788940538.350222:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940538.350226:0:7074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5833800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738275200:12345-0@lo:400:kworker.0 Request processed in 189us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940538.350234:0:7074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788940538.350251:0:7074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738275456 00000100:00100000:2.0:1788940538.350254:0:7074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738275456 00000100:00100000:1.0:1788940538.350256:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738275072 00000100:00100000:1.0:1788940538.350258:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738275072 00000100:00100000:2.0:1788940538.350278:0:7074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788940538.350281:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1788940538.350287:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1baad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875839738275072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940538.350289:0:7074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1baad5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738275456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940538.350327:0:7074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1baad5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738275456:12345-0@lo:400:kworker.0 Request processed in 37us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940538.350332:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1baad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875839738275072:12345-0@lo:400:kworker.0 Request processed in 46us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940538.350334:0:7074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788940538.350354:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00080000:2.0:1788940538.350356:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788940538.350361:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788940538.350362:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788940538.350363:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738274944 00000100:00100000:1.0:1788940538.350377:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738274944 00000100:00100000:1.0:1788940538.350398:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788940538.350404:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1baad4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738275200:0@lo:400:kworker.0 00000100:00100000:1.0:1788940538.350404:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1baad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875839738274944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940538.350431:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1baad5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738275456:0@lo:400:kworker.0 00000100:00100000:1.0:1788940538.350432:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1baad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875839738274944:12345-0@lo:400:kworker.0 Request processed in 29us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940538.350438:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788940538.350448:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1baad5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875839738275072:0@lo:400:kworker.0 00000100:00100000:2.0:1788940538.350463:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1baad5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875839738274944:0@lo:400:kworker.0 00000100:00100000:1.0:1788940538.350479:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738274816 00000100:00100000:1.0:1788940538.350483:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738274816 00000100:00100000:1.0:1788940538.350505:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1788940538.350511:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f188d36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3306:x1875839738274816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940538.350559:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f188d36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3306:x1875839738274816:12345-0@lo:400:kworker.0 Request processed in 48us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940538.350565:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1788940538.355783:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788940538.355810:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b55c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738275584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788940538.355880:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940538.355978:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738275584 00000100:00100000:3.0:1788940538.355988:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738275584 00000100:00100000:3.0:1788940538.356061:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788940538.356072:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1baad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738275584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788940538.356123:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788940538.356182:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1baad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738275584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940538.356189:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788940538.356254:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b55c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738275584:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788940538.359763:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1baad4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3306:1875839738274816:0@lo:400:kworker.0 00000100:00100000:0.0:1788940538.359777:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1baad7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875839738275328:0@lo:400:kworker.0 00000100:00100000:0.0:1788940538.359830:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940538.360704:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738275328 00000100:00100000:1.0:1788940538.360714:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738275328 00000100:00080000:2.0:1788940538.360791:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940538.360834:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1788940538.360843:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f083ede300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875839738275328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940538.360905:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f083ede300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875839738275328:12345-0@lo:400:kworker.0 Request processed in 64us (1074us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940538.360911:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1788940538.360965:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1baad7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875839738275328:0@lo:400:kworker.0 00010000:00010000:3.0:1788940538.541273:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940539.564880:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940539.885694:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f083edd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738275712:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788940539.885812:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940539.885975:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738275712 00000100:00100000:0.0:1788940539.885999:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738275712 00000100:00100000:0.0:1788940539.886075:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788940539.886084:0:6710:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1788940539.886089:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f184195180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738275712:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788940539.886117:0:6710:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:0.0:1788940539.886149:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788940539.886248:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f184195180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738275712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 163us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940539.886255:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788940539.886466:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f083edd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738275712:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788940540.386277:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940540.386324:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940540.386351:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940540.396480:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718369152 00000100:00100000:0.0:1788940540.396497:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718369152 00000100:00100000:0.0:1788940540.398212:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718369408 00000100:00100000:0.0:1788940540.398220:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718369408 00000100:00100000:0.0:1788940540.398237:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718369280 00000100:00100000:0.0:1788940540.398239:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718369280 00000100:00100000:0.0:1788940540.398262:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 22 00000100:00100000:0.0:1788940540.398275:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1baad7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0b05a86-29c8-44a6-9c64-75d9d650043e+12:2352:x1875839718369152:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940540.398292:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940540.398313:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f19258c800/0x27a633fcdd4ab65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f56bd expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940540.398331:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940540.398410:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1baad7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0b05a86-29c8-44a6-9c64-75d9d650043e+11:2352:x1875839718369152:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 137us (12143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940540.398418:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 22 00000100:00100000:0.0:1788940540.398437:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 23 00000100:00100000:0.0:1788940540.398443:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1923c5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0b05a86-29c8-44a6-9c64-75d9d650043e+10:2352:x1875839718369408:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940540.398454:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940540.398464:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f180031e00/0x27a633fcdd4ad2c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f576c expref: 10 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940540.398473:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940540.398492:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1923c5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0b05a86-29c8-44a6-9c64-75d9d650043e+9:2352:x1875839718369408:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 49us (12168us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940540.398498:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 23 00000100:00100000:0.0:1788940540.398581:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 24 00000100:00100000:0.0:1788940540.398588:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1baad7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0b05a86-29c8-44a6-9c64-75d9d650043e+8:2352:x1875839718369280:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940540.398597:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940540.398618:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f082ad2a00/0x27a633fcdd4ab6c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f56e7 expref: 8 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940540.398629:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940540.398648:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1baad7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0b05a86-29c8-44a6-9c64-75d9d650043e+7:2352:x1875839718369280:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 60us (12296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940540.398653:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 24 00000100:00100000:3.0:1788940540.422106:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940540.422332:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718369664 00000100:00100000:3.0:1788940540.422344:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718369664 00000100:00100000:3.0:1788940540.425152:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 241 00000100:00100000:3.0:1788940540.425174:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b55c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffa310cd-169f-42e3-8999-506116bada08+6:2349:x1875839718369664:12345-192.168.202.14@tcp:39:umount.0 00000020:00000080:3.0:1788940540.425226:0:5861:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x27a633fcdd4ab7a 00000020:00010000:3.0:1788940540.425236:0:5861:0:(genops.c:1929:obd_stale_export_put()) Put export ffff89f192366000: total 0 00000100:00080000:3.0:1788940540.425241:0:5861:0:(import.c:65:import_set_state_nolock()) ffff89f192365800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788940540.425264:0:5861:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:3.0:1788940540.427422:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b55c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffa310cd-169f-42e3-8999-506116bada08+5:2349:x1875839718369664:12345-192.168.202.14@tcp:39:umount.0 Request processed in 2247us (5322us total) trans 4294967527 rc 0/0 00000100:00100000:3.0:1788940540.427435:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 241 00000100:00080000:3.0:1788940540.429211:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:3.0:1788940540.429287:0:7648:0:(genops.c:1915:obd_stale_export_get()) Get export ffff89f192366000: total 0 00010000:00010000:3.0:1788940540.429337:0:7648:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff89f192366000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788940540.429387:0:7648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f186946e00) 00010000:00010000:3.0:1788940540.429391:0:7648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788940540.429402:0:7648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4baa7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5b1d expref: 4 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940540.429425:0:7648:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff89f192366000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1788940540.429436:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940540.429438:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940540.429439:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940540.466626:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940540.467177:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718369920 00000100:00100000:2.0:1788940540.467192:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718369920 00000100:00100000:2.0:1788940540.467252:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 321 00000100:00100000:2.0:1788940540.467263:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f188d37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+7:2349:x1875839718369920:12345-192.168.202.14@tcp:251:umount.0 00000020:00000080:2.0:1788940540.467309:0:5855:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x27a633fcdd4aa70 00000020:00010000:2.0:1788940540.467318:0:5855:0:(genops.c:1929:obd_stale_export_put()) Put export ffff89f1ba91d800: total 0 00000100:00080000:2.0:1788940540.467323:0:5855:0:(import.c:65:import_set_state_nolock()) ffff89f1ba91e800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788940540.467404:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f188d37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0b05a86-29c8-44a6-9c64-75d9d650043e+3:2349:x1875839718369920:12345-192.168.202.14@tcp:251:umount.0 Request processed in 143us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940540.467412:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 321 00000020:00010000:2.0:1788940540.467479:0:5848:0:(genops.c:1915:obd_stale_export_get()) Get export ffff89f1ba91d800: total 0 00010000:00010000:2.0:1788940540.467556:0:5848:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff89f1ba91d800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788940540.467594:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f082ad3000/0x27a633fcdd4ab26 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f56af expref: 2 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940540.467608:0:5848:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff89f1ba91d800, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1788940540.467617:0:5848:0:(genops.c:893:class_export_put()) final put ffff89f1ba91d800/f0b05a86-29c8-44a6-9c64-75d9d650043e 00010000:00010000:2.0:1788940540.467630:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940540.467632:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940540.467634:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788940540.467738:0:38:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1ba91d800/f0b05a86-29c8-44a6-9c64-75d9d650043e for MGS 00000020:00000080:2.0:1788940540.467780:0:38:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff89f1ba91e800 for MGS 00000001:00100000:1.0:1788940540.480984:0:5883:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9c51ff78-d02d-4e61-8a10-a2f8830f1679 00000001:00080000:1.0:1788940540.481002:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:1.0:1788940540.481019:0:5883:0:(genops.c:893:class_export_put()) final put ffff89f1ae71e800/9c51ff78-d02d-4e61-8a10-a2f8830f1679 00000020:00000080:2.0:1788940540.482867:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1ae71e800/9c51ff78-d02d-4e61-8a10-a2f8830f1679 for lustre-MDT0000 00000020:00000080:2.0:1788940540.482943:0:36:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff89f1ae71a800 for lustre-MDT0000 00000001:00100000:2.0:1788940540.499746:0:6732:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9c51ff78-d02d-4e61-8a10-a2f8830f1679 00000020:00000080:2.0:1788940540.499757:0:6732:0:(genops.c:893:class_export_put()) final put ffff89f1b8970000/9c51ff78-d02d-4e61-8a10-a2f8830f1679 00000020:00000080:0.0:1788940540.499822:0:38:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1b8970000/9c51ff78-d02d-4e61-8a10-a2f8830f1679 for lustre-OST0000 00000020:00000080:0.0:1788940540.499877:0:38:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff89f1b8975000 for lustre-OST0000 00010000:00010000:0.0:1788940540.588954:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788940541.616788:0:11708:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788940541.616815:0:11708:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788940541.617360:0:11708:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1788940541.617370:0:11708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788940541.625348:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940542.638858:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788940543.060506:0:13053:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788940543.091847:0:13053:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1788940543.091923:0:13053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f19258da00/0x27a633fcdd4aaf5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4aafc expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940543.091943:0:13053:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f19258da00/0x27a633fcdd4aaf5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4aafc expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940543.091963:0:13053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f19258da00/0x27a633fcdd4aaf5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x27a633fcdd4aafc expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940543.091971:0:13053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.114@tcp lock: ffff89f19258da00/0x27a633fcdd4aaf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x27a633fcdd4aafc expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940543.092000:0:13053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788940543.092007:0:13053:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788940543.092040:0:13053:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788940543.092046:0:13053:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788940543.092054:0:13053:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788940543.092084:0:13053:0:(import.c:65:import_set_state_nolock()) ffff89f1b0646000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1788940543.092175:0:7648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940543.092185:0:7648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff89f19258da00/0x27a633fcdd4aaf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x27a633fcdd4aafc expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940543.092195:0:7648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258da00 already unused, calling callback (ffffffffc1d10c20) 10000000:00010000:3.0:1788940543.092198:0:7648:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff89f19258da00/0x27a633fcdd4aaf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x27a633fcdd4aafc expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940543.092209:0:7648:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff89f19258da00/0x27a633fcdd4aaf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x27a633fcdd4aafc expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788940543.092219:0:7648:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff89f19258da00/0x27a633fcdd4aaf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x27a633fcdd4aafc expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940543.092226:0:7648:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788940543.092229:0:7648:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788940543.092233:0:7648:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788940543.092268:0:7648:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff89f19258da00/0x27a633fcdd4aaf5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x27a633fcdd4aafc expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940543.092276:0:7648:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788940543.092303:0:7648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff89f19258da00/0x27a633fcdd4aaf5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x27a633fcdd4aafc expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940543.092312:0:7648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff89f19258da00/0x27a633fcdd4aaf5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x27a633fcdd4aafc expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940543.092350:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940543.092353:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940543.092355:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940543.092377:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b55c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3306:1875839738275968:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788940543.092479:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940543.092613:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738275968 00000100:00100000:3.0:1788940543.092622:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738275968 00000100:00100000:3.0:1788940543.092680:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788940543.092692:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b55c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3306:x1875839738275968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788940543.092709:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940543.092728:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f1829dbc00/0x27a633fcdd4aafc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x27a633fcdd4aaf5 expref: 19 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940543.092745:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940543.092791:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b55c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1220f165-b68f-42ea-b6cd-5f8ad1a18830+18:3306:x1875839738275968:12345-0@lo:103:ldlm_bl.0 Request processed in 102us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940543.092800:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788940543.092850:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b55c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3306:1875839738275968:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788940543.095397:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f184194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875839738275840:0@lo:39:umount.0 00000100:00100000:1.0:1788940543.095491:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940543.095638:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738275840 00000100:00100000:2.0:1788940543.095648:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738275840 00000100:00100000:2.0:1788940543.095717:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788940543.095727:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1baad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875839738275840:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788940543.095763:0:5862:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x27a633fcdd4a88d 00000100:00080000:2.0:1788940543.095793:0:5862:0:(import.c:65:import_set_state_nolock()) ffff89f19016f800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788940543.095873:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1baad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3304:x1875839738275840:12345-0@lo:39:umount.0 Request processed in 147us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940543.095882:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:2.0:1788940543.095907:0:5862:0:(genops.c:893:class_export_put()) final put ffff89f19016c000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1788940543.095937:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffff89f19016c000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788940543.096004:0:36:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff89f19016f800 for lustre-MDT0000 00010000:00010000:3.0:1788940543.096070:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788940543.097802:0:3304:0:(import.c:65:import_set_state_nolock()) ffff89f1b0646000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788940543.097834:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f184194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875839738275840:0@lo:39:umount.0 00000100:00080000:2.0:1788940543.097987:0:13053:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788940543.097994:0:13053:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788940543.098000:0:13053:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788940543.100690:0:13053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f082ad2400/0x27a633fcdd4ab03 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4ab0a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940543.100715:0:13053:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f082ad2400/0x27a633fcdd4ab03 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4ab0a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940543.100723:0:13053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f082ad2400/0x27a633fcdd4ab03 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x27a633fcdd4ab0a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940543.100746:0:13053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.114@tcp lock: ffff89f082ad2400/0x27a633fcdd4ab03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x27a633fcdd4ab0a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940543.100777:0:13053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788940543.100785:0:13053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f181521000/0x27a633fcdd4aa2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4aa31 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940543.100791:0:13053:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f181521000/0x27a633fcdd4aa2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4aa31 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940543.100797:0:13053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f181521000/0x27a633fcdd4aa2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x27a633fcdd4aa31 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940543.100804:0:13053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.114@tcp lock: ffff89f181521000/0x27a633fcdd4aa2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x27a633fcdd4aa31 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940543.100826:0:13053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788940543.100834:0:13053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f082ad2c00/0x27a633fcdd4ad1e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4ad25 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940543.100841:0:13053:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f082ad2c00/0x27a633fcdd4ad1e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4ad25 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940543.100848:0:13053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f082ad2c00/0x27a633fcdd4ad1e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x27a633fcdd4ad25 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940543.100854:0:13053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.114@tcp lock: ffff89f082ad2c00/0x27a633fcdd4ad1e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x27a633fcdd4ad25 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940543.100882:0:13053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788940543.100895:0:7649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788940543.100895:0:7650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788940543.100904:0:7649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff89f181521000/0x27a633fcdd4aa2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x27a633fcdd4aa31 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940543.100906:0:7650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff89f082ad2400/0x27a633fcdd4ab03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x27a633fcdd4ab0a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940543.100923:0:7649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f181521000 already unused, calling callback (ffffffffc1d10c20) 00010000:00010000:1.0:1788940543.100927:0:7650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad2400 already unused, calling callback (ffffffffc1d10c20) 10000000:00010000:3.0:1788940543.100929:0:7649:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff89f181521000/0x27a633fcdd4aa2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x27a633fcdd4aa31 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788940543.100932:0:7650:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff89f082ad2400/0x27a633fcdd4ab03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x27a633fcdd4ab0a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940543.100957:0:7650:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff89f082ad2400/0x27a633fcdd4ab03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x27a633fcdd4ab0a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940543.100958:0:7649:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff89f181521000/0x27a633fcdd4aa2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x27a633fcdd4aa31 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788940543.100982:0:7649:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff89f181521000/0x27a633fcdd4aa2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x27a633fcdd4aa31 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788940543.100982:0:7650:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff89f082ad2400/0x27a633fcdd4ab03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x27a633fcdd4ab0a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940543.100999:0:7649:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788940543.101002:0:7649:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1788940543.101004:0:7649:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 10000000:01000000:1.0:1788940543.101009:0:7650:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788940543.101013:0:7650:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1788940543.101050:0:7650:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff89f082ad2400/0x27a633fcdd4ab03 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x27a633fcdd4ab0a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940543.101051:0:7649:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff89f181521000/0x27a633fcdd4aa2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x27a633fcdd4aa31 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940543.101071:0:7650:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788940543.101072:0:7649:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788940543.101091:0:7650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff89f082ad2400/0x27a633fcdd4ab03 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x27a633fcdd4ab0a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940543.101101:0:7650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff89f082ad2400/0x27a633fcdd4ab03 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x27a633fcdd4ab0a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940543.101102:0:7649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff89f181521000/0x27a633fcdd4aa2a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x27a633fcdd4aa31 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940543.101119:0:7649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff89f181521000/0x27a633fcdd4aa2a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x27a633fcdd4aa31 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940543.101133:0:7650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940543.101139:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940543.101139:0:7650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff89f082ad2c00/0x27a633fcdd4ad1e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x27a633fcdd4ad25 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940543.101147:0:7650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad2c00 already unused, calling callback (ffffffffc1d10c20) 00010000:00010000:3.0:1788940543.101148:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940543.101153:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:1.0:1788940543.101154:0:7650:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff89f082ad2c00/0x27a633fcdd4ad1e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x27a633fcdd4ad25 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940543.101176:0:7650:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff89f082ad2c00/0x27a633fcdd4ad1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x27a633fcdd4ad25 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940543.101179:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b55c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3307:1875839738276096:0@lo:103:ldlm_bl.0 10000000:00010000:1.0:1788940543.101188:0:7650:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff89f082ad2c00/0x27a633fcdd4ad1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x27a633fcdd4ad25 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940543.101196:0:7650:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788940543.101199:0:7650:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788940543.101201:0:7650:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788940543.101218:0:7650:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff89f082ad2c00/0x27a633fcdd4ad1e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x27a633fcdd4ad25 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940543.101225:0:7650:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788940543.101233:0:7650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff89f082ad2c00/0x27a633fcdd4ad1e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x27a633fcdd4ad25 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940543.101247:0:7650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff89f082ad2c00/0x27a633fcdd4ad1e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x27a633fcdd4ad25 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940543.101258:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940543.101260:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940543.101262:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940543.101279:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940543.101345:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1baad6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3307:1875839738276224:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788940543.101369:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940543.101395:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788940543.101400:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1baad6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3307:1875839738276352:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788940543.101422:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940543.101458:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738276096 00000100:00100000:3.0:1788940543.101466:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738276096 00000100:00100000:3.0:1788940543.101548:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738276224 00000100:00100000:1.0:1788940543.101549:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738276352 00000100:00100000:3.0:1788940543.101553:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738276224 00000100:00100000:1.0:1788940543.101556:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738276352 00000100:00100000:3.0:1788940543.101582:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788940543.101592:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b55c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+20:3307:x1875839738276096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788940543.101607:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940543.101623:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f082ad3a00/0x27a633fcdd4aa31 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x27a633fcdd4aa2a expref: 20 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940543.101645:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940543.101677:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b55c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3307:x1875839738276096:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (400us total) trans 0 rc 0/0 00010000:00010000:2.0:1788940543.101730:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940543.115911:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788940543.115940:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b55c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+19:3307:x1875839738276224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788940543.115981:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940543.116023:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f181521e00/0x27a633fcdd4ab0a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x27a633fcdd4ab03 expref: 19 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940543.116048:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940543.116139:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b55c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+18:3307:x1875839738276224:12345-0@lo:103:ldlm_bl.0 Request processed in 211us (14769us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940543.116147:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788940543.116185:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788940543.116192:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b55c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+17:3307:x1875839738276352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788940543.116199:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940543.116209:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f188dabc00/0x27a633fcdd4ad25 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x27a633fcdd4ad1e expref: 17 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940543.116219:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940543.116241:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b55c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+16:3307:x1875839738276352:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (14818us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940543.116268:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788940543.120353:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788940543.120968:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1baad6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3307:1875839738276352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788940543.120987:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b55c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3307:1875839738276096:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788940543.120997:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1baad6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3307:1875839738276224:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788940543.123926:0:13053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f1829da600/0x27a633fcdd4a7de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4a7e5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940543.123963:0:13053:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f1829da600/0x27a633fcdd4a7de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4a7e5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940543.124000:0:13053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f1829da600/0x27a633fcdd4a7de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x27a633fcdd4a7e5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940543.124008:0:13053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.114@tcp lock: ffff89f1829da600/0x27a633fcdd4a7de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x27a633fcdd4a7e5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940543.124044:0:13053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788940543.124052:0:13053:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1788940543.124062:0:13053:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1788940543.124106:0:13053:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1788940543.124112:0:13053:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1788940543.124118:0:13053:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788940543.124125:0:13053:0:(obd_config.c:1048:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:3.0:1788940543.124135:0:13053:0:(genops.c:1827:print_export_data()) lustre-MDT0000: ACTIVE ffff89f1bf53b000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788940543.124142:0:13053:0:(genops.c:1827:print_export_data()) lustre-MDT0000: ACTIVE ffff89f1aeedb800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788940543.124151:0:13053:0:(genops.c:1827:print_export_data()) lustre-MDT0000: UNLINKED ffff89f192366000 ffa310cd-169f-42e3-8999-506116bada08 192.168.202.14@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788940543.124157:0:13053:0:(genops.c:1561:class_disconnect_exports()) OBD device 5 (ffff89f1b5c7cd88) has exports, disconnecting them 00000020:00080000:3.0:1788940543.124163:0:13053:0:(genops.c:1536:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff89f1bf53b000), last request at 1788940538 00000020:00000080:3.0:1788940543.124172:0:13053:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x27a633fcdd4a9f2 00000100:00080000:3.0:1788940543.124195:0:13053:0:(import.c:65:import_set_state_nolock()) ffff89f19016b000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788940543.124247:0:5848:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940543.124254:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff89f1829da600/0x27a633fcdd4a7de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x27a633fcdd4a7e5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940543.124261:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1829da600 already unused, calling callback (ffffffffc1d10c20) 10000000:00010000:3.0:1788940543.124265:0:5848:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff89f1829da600/0x27a633fcdd4a7de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x27a633fcdd4a7e5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940543.124285:0:5848:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff89f1829da600/0x27a633fcdd4a7de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x27a633fcdd4a7e5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788940543.124294:0:5848:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff89f1829da600/0x27a633fcdd4a7de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x27a633fcdd4a7e5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940543.124299:0:5848:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788940543.124301:0:5848:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788940543.124303:0:5848:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788940543.124342:0:5848:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff89f1829da600/0x27a633fcdd4a7de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x27a633fcdd4a7e5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940543.124355:0:5848:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788940543.124379:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff89f1829da600/0x27a633fcdd4a7de lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x27a633fcdd4a7e5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940543.124386:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff89f1829da600/0x27a633fcdd4a7de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x27a633fcdd4a7e5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940543.124616:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940543.124619:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940543.124621:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940543.124641:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b55c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3305:1875839738276480:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788940543.124734:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1788940543.124825:0:13053:0:(genops.c:1541:class_disconnect_export_list()) disconnected export at 0@lo (ffff89f1bf53b000): rc 0 00000020:00000080:3.0:1788940543.124828:0:13053:0:(genops.c:893:class_export_put()) final put ffff89f1bf53b000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1788940543.124849:0:13053:0:(genops.c:1536:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff89f1aeedb800), last request at 1788940538 00000020:00000080:3.0:1788940543.124854:0:13053:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x27a633fcdd4a927 00000100:00080000:3.0:1788940543.124862:0:13053:0:(import.c:65:import_set_state_nolock()) ffff89f1aeedd800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788940543.124942:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788940543.124961:0:13053:0:(genops.c:1541:class_disconnect_export_list()) disconnected export at 0@lo (ffff89f1aeedb800): rc 0 00000020:00000080:3.0:1788940543.124963:0:13053:0:(genops.c:893:class_export_put()) final put ffff89f1aeedb800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:3.0:1788940543.124972:0:13053:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffff98fc41783ae0 00000100:00080000:3.0:1788940543.124997:0:13053:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788940543.125001:0:13053:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:3.0:1788940543.125014:0:13053:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788940543.125089:0:13053:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788940543.125103:0:13053:0:(import.c:65:import_set_state_nolock()) ffff89f1ae830000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788940543.125117:0:13053:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788940543.125119:0:13053:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:3.0:1788940543.125129:0:13053:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788940543.125197:0:13053:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788940543.125205:0:13053:0:(import.c:65:import_set_state_nolock()) ffff89f1b4d02800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1788940543.125237:0:13053:0:(genops.c:1566:class_disconnect_exports()) OBD device 5 (ffff89f1b5c7cd88) has no exports 00000100:00100000:1.0:1788940543.125306:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738276480 00000100:00100000:1.0:1788940543.125317:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738276480 00000100:00100000:1.0:1788940543.125382:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788940543.125393:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b55c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+15:3305:x1875839738276480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788940543.125408:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940543.125427:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f1829daa00/0x27a633fcdd4a7e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x27a633fcdd4a7de expref: 15 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940543.125446:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940543.125496:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b55c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1220f165-b68f-42ea-b6cd-5f8ad1a18830+14:3305:x1875839738276480:12345-0@lo:103:ldlm_bl.0 Request processed in 105us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940543.125504:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788940543.125548:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b55c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875839738276608:0@lo:9:umount.0 00000100:00100000:1.0:1788940543.125586:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940543.125615:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b55c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875839738276736:0@lo:9:umount.0 00000020:00000080:2.0:1788940543.125620:0:38:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1bf53b000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00100000:1.0:1788940543.125641:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1788940543.125682:0:38:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1aeedb800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788940543.125710:0:38:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff89f19016b000 for lustre-MDT0000 00000020:00000080:2.0:1788940543.125718:0:38:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff89f1aeedd800 for lustre-MDT0000 00000100:00100000:1.0:1788940543.127489:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b55c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3305:1875839738276480:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788940543.127556:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738276608 00000100:00100000:1.0:1788940543.127563:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738276608 00000100:00100000:1.0:1788940543.127620:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738276736 00000100:00100000:1.0:1788940543.127624:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738276736 00000100:00100000:1.0:1788940543.127649:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788940543.127659:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1baad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875839738276608:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788940543.127706:0:6708:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x27a633fcdd4a974 00000100:00080000:1.0:1788940543.127715:0:6708:0:(import.c:65:import_set_state_nolock()) ffff89f1aeede800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788940543.128328:0:6708:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00010000:00010000:0.0:1788940543.133289:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940543.133359:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788940543.133640:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1baad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3304:x1875839738276608:12345-0@lo:9:umount.0 Request processed in 5979us (8050us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940543.133652:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00010000:1.0:1788940543.133707:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788940543.133763:0:3304:0:(import.c:65:import_set_state_nolock()) ffff89f1ae830000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788940543.133784:0:3304:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788940543.133787:0:3304:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788940543.133791:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b55c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875839738276608:0@lo:9:umount.0 00000100:00100000:0.0:1788940543.133985:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1baad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875839738276736:12345-0@lo:9:umount.0 00000100:00080000:1.0:1788940543.135775:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788940543.135790:0:5856:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:0.0:1788940543.138191:0:6707:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x27a633fcdd4aa5b 00000100:00080000:0.0:1788940543.138209:0:6707:0:(import.c:65:import_set_state_nolock()) ffff89f1ba91a000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788940543.138268:0:6707:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:2.0:1788940543.138494:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940543.141201:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1baad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3304:x1875839738276736:12345-0@lo:9:umount.0 Request processed in 7821us (15549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940543.141215:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1788940543.141545:0:3304:0:(import.c:65:import_set_state_nolock()) ffff89f1b4d02800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788940543.141579:0:3304:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788940543.141582:0:3304:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788940543.141589:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b55c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875839738276736:0@lo:9:umount.0 00000020:00080000:2.0:1788940543.148386:0:13053:0:(genops.c:1566:class_disconnect_exports()) OBD device 5 (ffff89f1b5c7cd88) has no exports 00000020:00000080:2.0:1788940543.284114:0:13053:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x27a633fcdd4a839 00000020:00000080:2.0:1788940543.284132:0:13053:0:(genops.c:893:class_export_put()) final put ffff89f18873a800/lustre-QMT0000_UUID 00000020:01000000:2.0:1788940543.284164:0:13053:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1788940543.284354:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffff89f18873a800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1788940543.289542:0:13053:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788940543.289558:0:13053:0:(obd_config.c:1048:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788940543.289564:0:13053:0:(genops.c:1566:class_disconnect_exports()) OBD device 7 (ffff89f19801cd88) has no exports 00000020:00000080:3.0:1788940543.291710:0:13053:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x27a633fcdd4a832 00000020:00000080:3.0:1788940543.291724:0:13053:0:(genops.c:893:class_export_put()) final put ffff89f1af52b800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788940543.291803:0:13053:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788940543.291813:0:13053:0:(obd_config.c:958:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788940543.291816:0:13053:0:(genops.c:893:class_export_put()) final put ffff89f1af529800/lustre-QMT0000_UUID 00000020:00000080:3.0:1788940543.291819:0:13053:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1af529800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1788940543.291832:0:13053:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1788940543.292186:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1af52b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:1.0:1788940543.470736:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788940543.470762:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f083edc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875839738276864:0@lo:400:kworker.0 00000100:00100000:1.0:1788940543.470836:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940543.471030:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788940543.471040:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f083edf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875839738276992:0@lo:400:kworker.0 00000100:00100000:2.0:1788940543.471072:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940543.471165:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738276864 00000100:00100000:1.0:1788940543.471173:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738276864 00000100:00100000:1.0:1788940543.471216:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738276992 00000100:00100000:1.0:1788940543.471220:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738276992 00000100:00100000:1.0:1788940543.471238:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788940543.471248:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1baad6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3305:x1875839738276864:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788940543.471256:0:7857:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788940543.471312:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1baad6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3305:x1875839738276864:12345-0@lo:400:kworker.0 Request processed in 63us (475us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788940543.471328:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788940543.471347:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788940543.471368:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f184194a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3308:x1875839738276992:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788940543.471373:0:7857:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788940543.471400:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f184194a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3308:x1875839738276992:12345-0@lo:400:kworker.0 Request processed in 31us (328us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788940543.471405:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:1.0:1788940543.471440:0:3305:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788940543.471446:0:3305:0:(import.c:65:import_set_state_nolock()) ffff89f1c1871000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788940543.471449:0:3305:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788940543.473457:0:3308:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788940543.473465:0:3308:0:(import.c:65:import_set_state_nolock()) ffff89f1b5042000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788940543.473470:0:3308:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788940543.473476:0:3308:0:(import.c:65:import_set_state_nolock()) ffff89f1b5042000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788940543.473481:0:3308:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 263 00000100:00080000:2.0:1788940543.473503:0:3308:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89f1b5042000 using connection 192.168.202.114@tcp/0@lo 00000100:00100000:2.0:1788940543.473569:0:3308:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89f1ba974000 x1875839738277120/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788940543.473598:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f083edf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875839738276992:0@lo:400:kworker.0 00000100:00100000:2.0:1788940543.473633:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ba974000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1875839738277120:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1788940543.473698:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940543.473772:0:7857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738277120 00000100:00100000:2.0:1788940543.473779:0:7857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738277120 00000100:00100000:2.0:1788940543.473810:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1788940543.473817:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ba977b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3304:x1875839738277120:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1788940543.473834:0:7857:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:1.0:1788940543.525581:0:3305:0:(import.c:65:import_set_state_nolock()) ffff89f1c1871000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788940543.525592:0:3305:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 243 00000100:00080000:1.0:1788940543.525602:0:3305:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89f1c1871000 using connection 192.168.202.114@tcp/0@lo 00000100:00100000:1.0:1788940543.525707:0:3305:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89f1baad7100 x1875839738277248/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788940543.525748:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f083edc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875839738276864:0@lo:400:kworker.0 00000100:00100000:3.0:1788940543.525934:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1baad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1875839738277248:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1788940543.526022:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940543.526359:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738277248 00000100:00100000:0.0:1788940543.526385:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738277248 00000100:00100000:0.0:1788940543.526445:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788940543.526454:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b55c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3304:x1875839738277248:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1788940543.526473:0:5862:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788940543.526563:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b55c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3304:x1875839738277248:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 109us (541us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788940543.526571:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:1.0:1788940543.530108:0:3304:0:(import.c:65:import_set_state_nolock()) ffff89f1c1871000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788940543.530122:0:3304:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788940543.530128:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1baad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1875839738277248:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788940543.584777:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ba977b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3304:x1875839738277120:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 110949us (111069us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788940543.584792:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:1.0:1788940543.585202:0:3304:0:(import.c:65:import_set_state_nolock()) ffff89f1b5042000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788940543.585210:0:3304:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788940543.585214:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ba974000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1875839738277120:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:3.0:1788940543.660695:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940544.685260:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788940545.597294:0:5883:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ffa310cd-169f-42e3-8999-506116bada08 00000001:00080000:1.0:1788940545.597331:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:1.0:1788940545.597339:0:5883:0:(genops.c:893:class_export_put()) final put ffff89f192366000/ffa310cd-169f-42e3-8999-506116bada08 00000020:00000080:3.0:1788940545.597403:0:38:0:(genops.c:852:class_export_destroy()) destroying export ffff89f192366000/ffa310cd-169f-42e3-8999-506116bada08 for lustre-MDT0000 00000020:00000080:3.0:1788940545.597784:0:38:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff89f192365800 for lustre-MDT0000 00000001:00100000:2.0:1788940545.614184:0:6732:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788940545.614196:0:6732:0:(genops.c:893:class_export_put()) final put ffff89f1aeedb000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788940545.614498:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1aeedb000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788940545.614593:0:36:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff89f1aeede800 for lustre-OST0000 00010000:00010000:0.0:1788940545.709612:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940546.783573:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940547.820823:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788940548.171588:0:7662:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788940548.171601:0:7662:0:(genops.c:893:class_export_put()) final put ffff89f1ba91f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788940548.171684:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1ba91f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788940548.171740:0:36:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff89f1ba91a000 for lustre-OST0001 00000100:00100000:2.0:1788940548.589096:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b55c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3308:1875839738277376:0@lo:400:kworker.0 00000100:00100000:2.0:1788940548.589193:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788940548.589699:0:38:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788940548.589706:0:38:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788940548.589710:0:38:0:(import.c:65:import_set_state_nolock()) ffff89f1c1871000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788940548.589716:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 486 00000100:00080000:3.0:1788940548.589722:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788940548.589730:0:38:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89f1c1871000 using connection 192.168.202.114@tcp/0@lo 00000100:00100000:3.0:1788940548.589760:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89f1b55c2d80 x1875839738277504/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788940548.589778:0:38:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788940548.589781:0:38:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788940548.589782:0:38:0:(import.c:65:import_set_state_nolock()) ffff89f1b5042000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788940548.589785:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 486 00000100:00080000:3.0:1788940548.589788:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788940548.589791:0:38:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89f1b5042000 using connection 192.168.202.114@tcp/0@lo 00000100:00100000:3.0:1788940548.589805:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89f1b4c24700 x1875839738277632/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788940548.590147:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b55c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1875839738277504:0@lo:38:kworker.0 00000100:00100000:1.0:1788940548.590292:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940548.590321:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4c24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1875839738277632:0@lo:38:kworker.0 00000100:00100000:1.0:1788940548.590347:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940548.590512:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738277504 00000100:00100000:1.0:1788940548.590542:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738277504 00000100:00100000:1.0:1788940548.590576:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738277632 00000100:00100000:1.0:1788940548.590579:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738277632 00000100:00100000:1.0:1788940548.590596:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1788940548.590604:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1baad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3304:x1875839738277504:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1788940548.590622:0:5862:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788940548.592281:0:7857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1788940548.592295:0:7857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1baad7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3304:x1875839738277632:12345-0@lo:38:kworker.0 00010000:02000000:2.0:1788940548.592315:0:7857:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788940548.592425:0:7857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1baad7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3304:x1875839738277632:12345-0@lo:38:kworker.0 Request processed in 130us (2075us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788940548.592448:0:7857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00080000:2.0:1788940548.592505:0:3304:0:(import.c:65:import_set_state_nolock()) ffff89f1b5042000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788940548.592511:0:3304:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788940548.592514:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4c24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1875839738277632:0@lo:38:kworker.0 00000100:00100000:0.0:1788940548.593695:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738277376 00000100:00100000:0.0:1788940548.593708:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738277376 00000100:00100000:0.0:1788940548.593756:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1788940548.593764:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f188d36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+14:3308:x1875839738277376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940548.595105:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f188d36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1220f165-b68f-42ea-b6cd-5f8ad1a18830+14:3308:x1875839738277376:12345-0@lo:400:kworker.0 Request processed in 1336us (5918us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940548.595116:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1788940548.599972:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b55c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3308:1875839738277376:0@lo:400:kworker.0 00000100:00100000:1.0:1788940548.610428:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1baad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3304:x1875839738277504:12345-0@lo:38:kworker.0 Request processed in 19805us (20117us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788940548.610444:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00080000:2.0:1788940548.610847:0:3304:0:(import.c:65:import_set_state_nolock()) ffff89f1c1871000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788940548.610854:0:3304:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788940548.610858:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b55c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1875839738277504:0@lo:38:kworker.0 00010000:00010000:3.0:1788940548.847538:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788940549.357704:0:13053:0:(lprocfs_status_server.c:371:lprocfs_free_client_stats()) stat ffff89f1914d4480 - data ffff89f18fced0d8/ffff89f1b53ac000 00000020:01000000:3.0:1788940549.357825:0:13053:0:(lprocfs_status_server.c:371:lprocfs_free_client_stats()) stat ffff89f1bf575900 - data ffff89f1bfce2288/ffff89f1aebfec00 00000001:00000004:3.0:1788940549.363170:0:13053:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00080000:3.0:1788940549.486500:0:13053:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788940549.486514:0:13053:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:3.0:1788940549.486880:0:13053:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788940549.486910:0:13053:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788940549.492285:0:7036:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788940549.492295:0:7036:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:1.0:1788940549.492310:0:7036:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1788940549.493398:0:13053:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788940549.493407:0:13053:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:3.0:1788940549.493424:0:13053:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788940549.493427:0:13053:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788940549.493741:0:8068:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788940549.493747:0:8068:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:0.0:1788940549.493758:0:8068:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1788940549.561959:0:13053:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x27a633fcdd4a801 00000020:00000080:0.0:1788940549.561977:0:13053:0:(genops.c:893:class_export_put()) final put ffff89f1b5c76800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788940549.563485:0:38:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1b5c76800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788940549.563992:0:13053:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x27a633fcdd4a816 00000020:00000080:0.0:1788940549.564003:0:13053:0:(genops.c:893:class_export_put()) final put ffff89f1b5c73800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788940549.564053:0:13053:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1788940549.564061:0:13053:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788940549.564072:0:13053:0:(obd_config.c:1048:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788940549.564077:0:13053:0:(genops.c:1566:class_disconnect_exports()) OBD device 4 (ffff89f1982e4d88) has no exports 00000004:01000000:0.0:1788940549.564280:0:13053:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788940549.564291:0:13053:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x27a633fcdd4aa54 00000020:00000080:0.0:1788940549.564314:0:13053:0:(genops.c:893:class_export_put()) final put ffff89f1ae71d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788940549.564758:0:38:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1b5c73800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788940549.564839:0:13053:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788940549.564845:0:13053:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788940549.564856:0:13053:0:(obd_config.c:1048:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788940549.564858:0:13053:0:(genops.c:1566:class_disconnect_exports()) OBD device 17 (ffff89f1bf86cd88) has no exports 00000020:00000080:0.0:1788940549.564868:0:13053:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x27a633fcdd4aa4d 00000020:00000080:0.0:1788940549.564873:0:13053:0:(genops.c:893:class_export_put()) final put ffff89f1b4d01800/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1788940549.565316:0:13053:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788940549.565322:0:13053:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788940549.565328:0:13053:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:0.0:1788940549.565335:0:13053:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788940549.565339:0:13053:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788940549.565426:0:38:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1ae71d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788940549.565435:0:38:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1b4d01800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788940549.565512:0:13053:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788940549.565588:0:38:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff89f1b4d02800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788940549.565639:0:13053:0:(obd_config.c:958:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788940549.565643:0:13053:0:(genops.c:893:class_export_put()) final put ffff89f1b5046000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788940549.565646:0:13053:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1b5046000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1788940549.565653:0:13053:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788940549.565757:0:13053:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x27a633fcdd4a96d 00000020:00000080:0.0:1788940549.565764:0:13053:0:(genops.c:893:class_export_put()) final put ffff89f1ae834000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788940549.565809:0:13053:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788940549.565813:0:13053:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788940549.565818:0:13053:0:(obd_config.c:1048:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788940549.565821:0:13053:0:(genops.c:1566:class_disconnect_exports()) OBD device 13 (ffff89f1b5180000) has no exports 00000020:00000080:0.0:1788940549.565827:0:13053:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x27a633fcdd4a966 00000020:00000080:0.0:1788940549.565831:0:13053:0:(genops.c:893:class_export_put()) final put ffff89f1ae834800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788940549.566132:0:38:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1ae834000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788940549.566421:0:38:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1ae834800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788940549.566785:0:13053:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788940549.566790:0:13053:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788940549.566794:0:13053:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:0.0:1788940549.566801:0:13053:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788940549.566804:0:13053:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788940549.566883:0:13053:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788940549.566916:0:13053:0:(obd_config.c:958:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788940549.566954:0:13053:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788940549.566958:0:13053:0:(obd_config.c:958:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788940549.566962:0:13053:0:(genops.c:893:class_export_put()) final put ffff89f1b0641000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788940549.566965:0:13053:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1b0641000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788940549.566976:0:13053:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788940549.567166:0:13053:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x27a633fcdd4a81d 00000020:00000080:0.0:1788940549.567173:0:13053:0:(genops.c:893:class_export_put()) final put ffff89f1b5c75800/lustre-MDD0000_UUID 00000020:00000080:3.0:1788940549.567622:0:38:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff89f1ae830000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788940549.567631:0:38:0:(genops.c:893:class_export_put()) final put ffff89f1bf538000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788940549.567633:0:38:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1bf538000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1788940549.567639:0:38:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788940549.567843:0:13053:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788940549.567850:0:13053:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788940549.567857:0:13053:0:(obd_config.c:1048:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788940549.567862:0:13053:0:(genops.c:1566:class_disconnect_exports()) OBD device 6 (ffff89f1b5c799d8) has no exports 00000020:00000080:0.0:1788940549.567896:0:13053:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788940549.567901:0:13053:0:(obd_config.c:958:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788940549.567906:0:13053:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x27a633fcdd4a824 00000020:00000080:0.0:1788940549.567911:0:13053:0:(genops.c:893:class_export_put()) final put ffff89f1b5c77800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788940549.568165:0:38:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1b5c75800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1788940549.568170:0:38:0:(genops.c:893:class_export_put()) final put ffff89f1b5c71800/lustre-MDD0000_UUID 00000020:00000080:3.0:1788940549.568172:0:38:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1b5c71800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1788940549.568177:0:38:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788940549.569829:0:38:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1b5c77800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:1.0:1788940549.569867:0:13053:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89f188f09000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1788940549.569873:0:13053:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89f188f09000 3 00000020:01000004:1.0:1788940549.569876:0:13053:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff89f188f09000 from lustre-MDT0000 00000020:00000080:1.0:1788940549.569927:0:13053:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788940549.569939:0:13053:0:(obd_config.c:958:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1788940549.569944:0:13053:0:(genops.c:893:class_export_put()) final put ffff89f1b5c70000/lustre-MDT0000_UUID 00000020:00000080:1.0:1788940549.569947:0:13053:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1b5c70000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1788940549.569956:0:13053:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1788940549.570036:0:13053:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1788940549.570056:0:13053:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1788940549.570062:0:13053:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1788940549.570067:0:13053:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788940549.570073:0:13053:0:(obd_config.c:1048:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788940549.570082:0:13053:0:(genops.c:1827:print_export_data()) MGS: ACTIVE ffff89f19819a000 1220f165-b68f-42ea-b6cd-5f8ad1a18830 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788940549.570090:0:13053:0:(genops.c:1561:class_disconnect_exports()) OBD device 1 (ffff89f19801b3b0) has exports, disconnecting them 00000020:00080000:1.0:1788940549.570096:0:13053:0:(genops.c:1536:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff89f19819a000), last request at 1788940271 00000020:00000080:1.0:1788940549.570119:0:13053:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x27a633fcdd4a7c2 00000020:00010000:1.0:1788940549.570126:0:13053:0:(genops.c:1929:obd_stale_export_put()) Put export ffff89f19819a000: total 0 00000100:00080000:1.0:1788940549.570131:0:13053:0:(import.c:65:import_set_state_nolock()) ffff89f19819f800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788940549.570159:0:13053:0:(genops.c:1541:class_disconnect_export_list()) disconnected export at 0@lo (ffff89f19819a000): rc 0 00000020:00080000:1.0:1788940549.570167:0:13053:0:(genops.c:1566:class_disconnect_exports()) OBD device 1 (ffff89f19801b3b0) has no exports 00000100:00100000:1.0:1788940549.570231:0:5853:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff89f19028f600:5853] 0 exiting: rc = 1 00000020:00010000:0.0:1788940549.570373:0:7649:0:(genops.c:1915:obd_stale_export_get()) Get export ffff89f19819a000: total 0 00010000:00010000:0.0:1788940549.570379:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940549.570427:0:7649:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff89f19819a000, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1788940549.570464:0:7649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f188daa200/0x27a633fcdd4ad09 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x27a633fcdd4ad02 expref: 9 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940549.570484:0:7649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f188dab200/0x27a633fcdd4ad17 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x27a633fcdd4ad10 expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940549.570503:0:7649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f1c21f1800/0x27a633fcdd4a8da lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x27a633fcdd4a8d3 expref: 7 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940549.570553:0:7649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f1829db800/0x27a633fcdd4ab18 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x27a633fcdd4ab11 expref: 6 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940549.570567:0:7649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f181521a00/0x27a633fcdd4aac4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x27a633fcdd4aabd expref: 5 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940549.570588:0:7649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f19258d600/0x27a633fcdd4aad2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x27a633fcdd4aacb expref: 4 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940549.570599:0:7649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f181520400/0x27a633fcdd4aae0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x27a633fcdd4aad9 expref: 3 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940549.570612:0:7649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f181520000/0x27a633fcdd4aaee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x27a633fcdd4aae7 expref: 2 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940549.570624:0:7649:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff89f19819a000, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1788940549.570639:0:7649:0:(genops.c:893:class_export_put()) final put ffff89f19819a000/1220f165-b68f-42ea-b6cd-5f8ad1a18830 00010000:00010000:0.0:1788940549.570654:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940549.570657:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940549.570659:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940549.570685:0:5855:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff89f198078600:5855] 2 exiting: rc = 0 00000020:00000080:1.0:1788940549.570848:0:38:0:(genops.c:852:class_export_destroy()) destroying export ffff89f19819a000/1220f165-b68f-42ea-b6cd-5f8ad1a18830 for MGS 00000020:00000080:1.0:1788940549.570907:0:38:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff89f19819f800 for MGS 00000100:00100000:3.0:1788940549.572080:0:5854:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff89f184134000:5854] 1 exiting: rc = 0 00000100:00100000:1.0:1788940549.575966:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.575981:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.575990:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.575997:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.576005:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.576013:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.576020:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.576026:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.576033:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.576039:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.576046:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.576051:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.576058:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.576065:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.576072:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.576079:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.576086:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.576093:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.576125:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.576130:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.576137:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.576144:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.576151:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.576157:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.576164:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.576175:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.576181:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.576188:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.576195:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.576202:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.576209:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.576215:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.576221:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.576229:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.576235:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.576241:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.576248:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.576257:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.576263:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.576270:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.576277:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.576283:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.576289:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.576295:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.576301:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.576307:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.576315:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.576321:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.576329:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.576336:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.576836:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.576850:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.576857:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.576874:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.576880:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.576886:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.576914:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.576921:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.576927:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.576932:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.576938:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.576943:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.576950:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.576956:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1788940549.578467:0:13053:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788940549.578477:0:13053:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:1.0:1788940549.581393:0:13053:0:(lprocfs_status_server.c:371:lprocfs_free_client_stats()) stat ffff89f08288dc00 - data ffff89f1bfc29798/ffff89f1bfab2400 00000020:01000000:1.0:1788940549.581579:0:13053:0:(lprocfs_status_server.c:371:lprocfs_free_client_stats()) stat ffff89f187c08e00 - data ffff89f18ff4abd0/ffff89f188d35000 00000020:00000080:1.0:1788940549.582380:0:13053:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x27a633fcdd4a7a6 00000020:00000080:1.0:1788940549.582390:0:13053:0:(genops.c:893:class_export_put()) final put ffff89f18df7b800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788940549.582442:0:13053:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89f188f09000 from MGS, refs=2 00000020:01000004:1.0:1788940549.582446:0:13053:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89f188f09000 2 00000020:01000004:1.0:1788940549.582450:0:13053:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff89f188f09000 from MGS 00000020:00000080:1.0:1788940549.582479:0:13053:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788940549.582487:0:13053:0:(obd_config.c:958:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788940549.582490:0:13053:0:(genops.c:893:class_export_put()) final put ffff89f18df7d800/MGS 00000020:00000080:1.0:1788940549.582494:0:13053:0:(genops.c:852:class_export_destroy()) destroying export ffff89f18df7d800/MGS for MGS 00000020:01000000:1.0:1788940549.582502:0:13053:0:(genops.c:443:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1788940549.582608:0:13053:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788940549.582613:0:13053:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788940549.582620:0:13053:0:(obd_config.c:1048:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788940549.582628:0:13053:0:(genops.c:1827:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff89f1b5c70800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788940549.582636:0:13053:0:(genops.c:1561:class_disconnect_exports()) OBD device 8 (ffff89f1b5c78000) has exports, disconnecting them 00000020:00080000:1.0:1788940549.582642:0:13053:0:(genops.c:1536:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff89f1b5c70800), last request at 1788940273 00000020:00000080:1.0:1788940549.582647:0:13053:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x27a633fcdd4a871 00000020:00080000:1.0:1788940549.582675:0:13053:0:(genops.c:1541:class_disconnect_export_list()) disconnected export at 0@lo (ffff89f1b5c70800): rc 0 00000020:00000080:1.0:1788940549.582690:0:13053:0:(genops.c:893:class_export_put()) final put ffff89f1b5c70800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788940549.584304:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffff89f18df7b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788940549.586067:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1b5c70800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788940549.586594:0:13053:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788940549.586600:0:13053:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788940549.586606:0:13053:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788940549.586613:0:13053:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788940549.586838:0:13053:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788940549.586848:0:13053:0:(obd_config.c:958:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788940549.586856:0:13053:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89f188f09000 1 00000020:00000080:0.0:1788940549.586863:0:13053:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x27a633fcdd4a798 00000020:00000080:0.0:1788940549.586874:0:13053:0:(genops.c:893:class_export_put()) final put ffff89f18df7d000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788940549.586880:0:13053:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788940549.586897:0:13053:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788940549.586902:0:13053:0:(obd_config.c:1048:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788940549.586918:0:13053:0:(genops.c:1566:class_disconnect_exports()) OBD device 0 (ffff89f1982e19d8) has no exports 00000020:00000080:3.0:1788940549.587051:0:36:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff89f1b0646000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788940549.587060:0:36:0:(genops.c:893:class_export_put()) final put ffff89f1b5c77000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788940549.587062:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1b5c77000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1788940549.587073:0:36:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1788940549.587166:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffff89f18df7d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788940549.678063:0:13053:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788940549.678086:0:13053:0:(obd_config.c:958:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1788940549.678109:0:13053:0:(genops.c:893:class_export_put()) final put ffff89f188f0b000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788940549.678116:0:13053:0:(genops.c:852:class_export_destroy()) destroying export ffff89f188f0b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1788940549.678137:0:13053:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1788940549.678814:0:13053:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff89f188f0a000 00000020:01000000:3.0:1788940549.678844:0:13053:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1788940549.678849:0:13053:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788940549.678853:0:13053:0:(obd_config.c:1048:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788940549.678858:0:13053:0:(genops.c:1566:class_disconnect_exports()) OBD device 3 (ffff89f1982e33b0) has no exports 00000100:00100000:3.0:1788940549.678959:0:5860:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff89f198287a00:5860] 0 exiting: rc = 1 00000100:00100000:1.0:1788940549.678963:0:5861:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff89f198286600:5861] 1 exiting: rc = 0 00000100:00100000:1.0:1788940549.679111:0:5862:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff89f1b12faa00:5862] 2 exiting: rc = 0 00000100:00100000:2.0:1788940549.679231:0:7857:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff89f1a9485a00:7857] 3 exiting: rc = 0 00000100:00100000:3.0:1788940549.679932:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.679941:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.679948:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.679954:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.679959:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.679966:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.679972:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.679977:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.679983:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.679989:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.679994:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.679999:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.680006:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.680011:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.680016:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.680022:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.680027:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.680032:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.680037:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.680043:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.680049:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.680054:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.680061:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.680067:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.680075:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.680096:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.680102:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.680108:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.680114:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.680120:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.680125:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.682269:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.682277:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.682283:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.682290:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.682296:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.682302:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.682308:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.682315:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.682320:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.682329:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.682336:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.682343:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.682349:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.682355:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.682361:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.682367:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.682373:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.682381:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.682386:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.682392:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.682399:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.682406:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.682413:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.682420:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.682426:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.682431:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.682436:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.682442:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.682448:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.682480:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.682486:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.682494:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.682501:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940549.697733:0:5864:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff89f190289400:5864] 1 exiting: rc = 0 00000100:00100000:1.0:1788940549.698860:0:5863:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff89f190288a00:5863] 0 exiting: rc = 1 00000100:00100000:3.0:1788940549.702285:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.702299:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.702307:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.702315:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.702321:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.702328:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.702336:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.702345:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.702352:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.702359:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.702366:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.702373:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.702385:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.702391:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.702396:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.702401:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.702407:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.702413:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.702418:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.702424:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.702430:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.702437:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.702443:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.702448:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.702454:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.702459:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.702466:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.702473:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.702479:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.702485:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.702492:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.702557:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.702563:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.702569:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.702576:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.702582:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.702588:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.702594:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.702600:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.702605:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.702610:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.702616:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.702622:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.702635:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.702642:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.702647:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.702653:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.702658:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.702664:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.702669:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.702675:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.702689:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.702696:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.702702:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.702709:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.702714:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.702719:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.702725:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.702731:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.702736:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.702741:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.702747:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.702754:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.702760:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.703541:0:5866:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff89f190282000:5866] 1 exiting: rc = 0 00000100:00100000:0.0:1788940549.703870:0:5865:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff89f1981b8400:5865] 0 exiting: rc = 1 00000100:00100000:3.0:1788940549.704056:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.704066:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.704097:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.704105:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.704112:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.704119:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.704126:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.704132:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.704139:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.704146:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.704152:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.704172:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.704180:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.704186:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.704193:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.704200:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.704208:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.704214:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.704221:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.704229:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.704236:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.704244:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.704251:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.704274:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.704283:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.704290:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.704304:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.704311:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.704318:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.704324:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.704332:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.704339:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.704348:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.704355:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.704362:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.704385:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.704394:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.704410:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.704417:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.704424:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.704431:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.704438:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.704445:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.704452:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.704458:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.704464:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.704471:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.704496:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.704504:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.704510:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.704826:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.704836:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.704842:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.704849:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.704856:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.704863:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.704871:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.704877:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.704884:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.704916:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.704923:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.704929:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.704937:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.704949:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940549.724338:0:5868:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff89f1981aa400:5868] 1 exiting: rc = 0 00000100:00100000:3.0:1788940549.724785:0:5867:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff89f1981b8600:5867] 0 exiting: rc = 1 00000100:00100000:1.0:1788940549.724897:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.724907:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.724914:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.724919:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.724925:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.724930:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.724936:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.724941:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.724946:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.724952:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.724958:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.724964:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.724969:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.724974:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.724979:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.724985:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.724989:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.724995:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.725001:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.725007:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.725012:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.725017:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.725023:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.725029:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.725035:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.725041:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.725046:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.725052:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.725077:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.725082:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.725088:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.725094:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.725100:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.725105:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.725111:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.725117:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.725123:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.725130:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.725137:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.725143:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.725148:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.725154:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.725159:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.725165:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.725170:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.725175:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.725180:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.725186:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.725192:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.725197:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.725202:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.725208:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.725213:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.725218:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.725225:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.725230:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.725236:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.725241:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.725246:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.725252:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.725258:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.725264:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.725270:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.725285:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.725804:0:5870:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff89f18879e200:5870] 1 exiting: rc = 0 00000100:00100000:0.0:1788940549.725936:0:5869:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff89f1981b9800:5869] 0 exiting: rc = 1 00000100:00100000:1.0:1788940549.726169:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.726177:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.726183:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.726188:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.726196:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.726202:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.726209:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.726215:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.726221:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.726227:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.726232:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.726238:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.726244:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.726249:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.726255:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.726260:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.726266:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.726271:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.726276:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.726282:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.726287:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.726292:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.726298:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.726304:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.726309:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.726314:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.726320:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.726326:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.726333:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.726338:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.726343:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.726349:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.726353:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.726359:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.726379:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.726385:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.726390:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.726395:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.726401:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.726405:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.726411:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.726418:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.726423:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.726430:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.726436:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.726442:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.726448:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.726453:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.726459:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.726465:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.726470:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.726475:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.726481:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.726487:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.726494:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.726499:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.726504:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.726510:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.726545:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.726552:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.726558:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.726564:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.726569:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.726575:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.727052:0:5871:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff89f1981aa600:5871] 0 exiting: rc = 1 00000100:00100000:0.0:1788940549.727138:0:5872:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff89f18879e400:5872] 1 exiting: rc = 0 00000100:00100000:1.0:1788940549.727237:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.727245:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.727251:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.727256:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.727262:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.727282:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.727288:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.727294:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.727299:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.727305:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.727310:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.727316:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.727322:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.727329:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.727335:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.727341:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.727346:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.727351:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.727357:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.727362:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.727368:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.727374:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.727380:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.727386:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.727391:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.727397:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.727403:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.727408:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.727413:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.727418:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.727423:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.727429:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.727434:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.727439:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.727445:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.727452:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.727457:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.727462:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.727468:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.727472:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.727484:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.727489:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.727495:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.727500:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.727505:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.727511:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.727617:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.727625:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.727631:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.727637:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.727642:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.727647:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.727652:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.727657:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.727663:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.727668:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.727673:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.727678:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.728140:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.728152:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.728157:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.728163:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.728168:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940549.728173:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940549.738268:0:5875:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff89f18879f400:5875] 2 exiting: rc = 0 00000100:00100000:1.0:1788940549.738268:0:5874:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff89f182fb7000:5874] 1 exiting: rc = 0 00000100:00100000:1.0:1788940549.738596:0:5873:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff89f182fb6c00:5873] 0 exiting: rc = 1 00000100:00100000:3.0:1788940549.738750:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.738761:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.738768:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.738775:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.738782:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.738814:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.738821:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.738830:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.738837:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.738846:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.738946:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.738953:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.738964:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.738970:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.738981:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.738989:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.738997:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.739004:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.739015:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.739021:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.739027:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.739034:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.739042:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.739049:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.739073:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.739080:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.739087:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.739094:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.739101:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.739108:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.739114:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.739120:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.739127:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.739133:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.739139:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.739144:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.739150:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.739156:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.739163:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.739169:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.739185:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.739191:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.739198:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.739205:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.739211:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.739218:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.739226:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.739232:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.739253:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.739261:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.739267:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.739273:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.739280:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.739285:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.739292:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.739299:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.739306:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.739312:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.739318:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.739325:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.739332:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.739338:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.739345:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940549.739351:0:13053:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788940549.755193:0:13053:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788940549.755212:0:13053:0:(obd_config.c:958:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1788940549.755220:0:13053:0:(genops.c:893:class_export_put()) final put ffff89f1901aa000/MDS_uuid 00000020:00000080:1.0:1788940549.755226:0:13053:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1901aa000/MDS_uuid for MDS 00000020:01000000:1.0:1788940549.755237:0:13053:0:(genops.c:443:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1788940549.755436:0:13053:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1788940549.868655:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940550.896847:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940551.930012:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940552.943592:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788940553.184837:0:13208:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788940553.198233:0:13208:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1788940553.198284:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f1829da200/0x27a633fcdd4aad9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4aae0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940553.198299:0:13208:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f1829da200/0x27a633fcdd4aad9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4aae0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940553.198306:0:13208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f1829da200/0x27a633fcdd4aad9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x27a633fcdd4aae0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940553.198314:0:13208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.114@tcp lock: ffff89f1829da200/0x27a633fcdd4aad9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x27a633fcdd4aae0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940553.198334:0:13208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788940553.198340:0:13208:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:0.0:1788940553.198383:0:7649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940553.198391:0:7649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff89f1829da200/0x27a633fcdd4aad9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x27a633fcdd4aae0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940553.198399:0:7649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1829da200 already unused, calling callback (ffffffffc1d10c20) 10000000:00010000:0.0:1788940553.198403:0:7649:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff89f1829da200/0x27a633fcdd4aad9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x27a633fcdd4aae0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940553.198412:0:7649:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff89f1829da200/0x27a633fcdd4aad9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x27a633fcdd4aae0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788940553.198429:0:7649:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff89f1829da200/0x27a633fcdd4aad9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x27a633fcdd4aae0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940553.198435:0:7649:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788940553.198437:0:7649:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788940553.198439:0:7649:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788940553.198477:0:7649:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff89f1829da200/0x27a633fcdd4aad9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x27a633fcdd4aae0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940553.198483:0:7649:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788940553.198513:0:7649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff89f1829da200/0x27a633fcdd4aad9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x27a633fcdd4aae0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940553.198539:0:7649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff89f1829da200/0x27a633fcdd4aad9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x27a633fcdd4aae0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940553.198551:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940553.198553:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940553.198555:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788940553.198571:0:13208:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788940553.198576:0:13208:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788940553.198582:0:13208:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788940553.198588:0:13208:0:(import.c:65:import_set_state_nolock()) ffff89f1c1871000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1788940553.198592:0:13208:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788940553.198594:0:13208:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788940553.198596:0:13208:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788940553.199450:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f082ad3e00/0x27a633fcdd4aae7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4aaee expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940553.199478:0:13208:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f082ad3e00/0x27a633fcdd4aae7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4aaee expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940553.199485:0:13208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f082ad3e00/0x27a633fcdd4aae7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x27a633fcdd4aaee expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940553.199491:0:13208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.114@tcp lock: ffff89f082ad3e00/0x27a633fcdd4aae7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x27a633fcdd4aaee expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940553.199512:0:13208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788940553.199543:0:7648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940553.199549:0:7648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff89f082ad3e00/0x27a633fcdd4aae7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x27a633fcdd4aaee expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940553.199555:0:7648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad3e00 already unused, calling callback (ffffffffc1d10c20) 10000000:00010000:0.0:1788940553.199559:0:7648:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff89f082ad3e00/0x27a633fcdd4aae7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x27a633fcdd4aaee expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940553.199567:0:7648:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff89f082ad3e00/0x27a633fcdd4aae7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x27a633fcdd4aaee expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788940553.199573:0:7648:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff89f082ad3e00/0x27a633fcdd4aae7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x27a633fcdd4aaee expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940553.199579:0:7648:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788940553.199581:0:7648:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:0.0:1788940553.199602:0:7648:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff89f082ad3e00/0x27a633fcdd4aae7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x27a633fcdd4aaee expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940553.199617:0:7648:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788940553.199629:0:7648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff89f082ad3e00/0x27a633fcdd4aae7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x27a633fcdd4aaee expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940553.199635:0:7648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff89f082ad3e00/0x27a633fcdd4aae7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x27a633fcdd4aaee expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940553.199645:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940553.199647:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940553.199648:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940553.199660:0:13208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f188daa000/0x27a633fcdd4ad10 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4ad17 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940553.199666:0:13208:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f188daa000/0x27a633fcdd4ad10 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4ad17 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940553.199672:0:13208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f188daa000/0x27a633fcdd4ad10 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x27a633fcdd4ad17 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940553.199677:0:13208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.114@tcp lock: ffff89f188daa000/0x27a633fcdd4ad10 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x27a633fcdd4ad17 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940553.199690:0:13208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788940553.199695:0:13208:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:0.0:1788940553.199698:0:13208:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1788940553.199716:0:13208:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1788940553.199721:0:13208:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1788940553.199725:0:13208:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788940553.199730:0:13208:0:(obd_config.c:1048:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788940553.199735:0:13208:0:(genops.c:1566:class_disconnect_exports()) OBD device 11 (ffff89f1b51819d8) has no exports 00000020:00080000:0.0:1788940553.199764:0:13208:0:(genops.c:1566:class_disconnect_exports()) OBD device 11 (ffff89f1b51819d8) has no exports 00000100:00100000:3.0:1788940553.201036:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f083edd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3306:1875839738277888:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788940553.201110:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940553.201163:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788940553.201169:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f083eddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3306:1875839738277760:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788940553.201191:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940553.201234:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738277888 00000100:00100000:3.0:1788940553.201252:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738277888 00000100:00100000:3.0:1788940553.201300:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738277760 00000100:00100000:3.0:1788940553.201303:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738277760 00000100:00100000:3.0:1788940553.201326:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788940553.201333:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1923c4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3306:x1875839738277888:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788940553.201340:0:5845:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788940553 with bad export cookie 178564260921911234 00010000:00010000:1.0:1788940553.203545:0:7650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940553.203560:0:7650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff89f188daa000/0x27a633fcdd4ad10 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x27a633fcdd4ad17 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940553.203589:0:7650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188daa000 already unused, calling callback (ffffffffc1d10c20) 10000000:00010000:1.0:1788940553.203594:0:7650:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff89f188daa000/0x27a633fcdd4ad10 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x27a633fcdd4ad17 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940553.203605:0:7650:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff89f188daa000/0x27a633fcdd4ad10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x27a633fcdd4ad17 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788940553.203613:0:7650:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff89f188daa000/0x27a633fcdd4ad10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x27a633fcdd4ad17 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940553.203620:0:7650:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788940553.203623:0:7650:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788940553.203626:0:7650:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788940553.203671:0:7650:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff89f188daa000/0x27a633fcdd4ad10 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x27a633fcdd4ad17 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940553.203678:0:7650:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788940553.203711:0:7650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff89f188daa000/0x27a633fcdd4ad10 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x27a633fcdd4ad17 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940553.204633:0:7650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff89f188daa000/0x27a633fcdd4ad10 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x27a633fcdd4ad17 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940553.204651:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940553.204653:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940553.204655:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940553.204675:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1baad4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3307:1875839738278016:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788940553.204852:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940553.205316:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738278016 00000100:00100000:2.0:1788940553.205326:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738278016 00000100:00100000:2.0:1788940553.205359:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788940553.206561:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4c24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3306:x1875839738277760:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788940553.206570:0:5846:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788940553 with bad export cookie 178564260921911234 00000100:00100000:2.0:1788940553.206644:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4c24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3306:x1875839738277760:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (5452us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788940553.206652:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788940553.206677:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788940553.206682:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1baad5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3307:x1875839738278016:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788940553.206686:0:5846:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788940553 with bad export cookie 178564260921911234 00000100:00100000:2.0:1788940553.206729:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1baad5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3307:x1875839738278016:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (1878us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788940553.206735:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1788940553.207929:0:3307:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.114@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788940553.207935:0:3307:0:(import.c:65:import_set_state_nolock()) ffff89f1901ab800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1788940553.207954:0:3307:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.114@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000020:01000000:0.0:1788940553.208115:0:13208:0:(lprocfs_status_server.c:371:lprocfs_free_client_stats()) stat ffff89f1bf579080 - data ffff89f18fced360/ffff89f1aeb8d400 00000020:01000000:0.0:1788940553.208256:0:13208:0:(lprocfs_status_server.c:371:lprocfs_free_client_stats()) stat ffff89f184076d00 - data ffff89f18fd7d438/ffff89f1b542b800 00000100:00100000:3.0:1788940553.215682:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1923c4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3306:x1875839738277888:12345-0@lo:103:ldlm_bl.0 Request processed in 14345us (14568us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788940553.215695:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1788940553.222742:0:3306:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.114@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788940553.230570:0:3307:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.114@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1788940553.230575:0:3307:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788940553.230583:0:3307:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff89f083edd880 x1875839738277888/t0(0) o103->MGC192.168.202.114@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788940569 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940553.230596:0:3307:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff89f083eddf80 x1875839738277760/t0(0) o103->MGC192.168.202.114@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788940569 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940553.230604:0:3307:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff89f1baad4380 x1875839738278016/t0(0) o103->MGC192.168.202.114@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788940569 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788940553.230744:0:3306:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff89f1901ab800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:0.0:1788940553.231006:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f083edd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3306:1875839738277888:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788940553.231036:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f083eddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3306:1875839738277760:0@lo:103:ldlm_bl.0 10000000:01000000:2.0:1788940553.231088:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788940553.231092:0:3307:0:(pinger.c:194:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788940553.231093:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788940553.231097:0:3307:0:(import.c:65:import_set_state_nolock()) ffff89f1901ab800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788940553.231102:0:3307:0:(import.c:545:import_select_connection()) MGC192.168.202.114@tcp: connect to NID 0@lo last attempt 214 00000100:00080000:2.0:1788940553.231111:0:3307:0:(import.c:665:import_select_connection()) MGC192.168.202.114@tcp: import ffff89f1901ab800 using connection 192.168.202.114@tcp/0@lo 00000100:00100000:2.0:1788940553.231143:0:3307:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89f1ba976300 x1875839738278144/t0(0) o250->MGC192.168.202.114@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788940553.231195:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ba976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3304:1875839738278144:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:1.0:1788940553.231256:0:3304:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875839738278144 offset 0 length 520: 4 00000100:00100000:2.0:1788940553.231323:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1baad4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3307:1875839738278016:0@lo:103:ldlm_bl.0 00100000:10000000:2.0:1788940553.252696:0:13208:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788940553.271051:0:13208:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x27a633fcdd4a8f6 00000020:00000080:0.0:1788940553.271061:0:13208:0:(genops.c:893:class_export_put()) final put ffff89f1bf53a800/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1788940553.271084:0:13208:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89f19016d800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1788940553.271088:0:13208:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89f19016d800 2 00000020:01000004:0.0:1788940553.271091:0:13208:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff89f19016d800 from lustre-OST0000 00000020:00000080:0.0:1788940553.271112:0:13208:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788940553.271121:0:13208:0:(obd_config.c:958:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1788940553.271124:0:13208:0:(genops.c:893:class_export_put()) final put ffff89f1bf53f000/lustre-OST0000_UUID 00000020:00000080:0.0:1788940553.271127:0:13208:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1bf53f000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1788940553.271133:0:13208:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1788940553.271179:0:13208:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1788940553.271183:0:13208:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788940553.271186:0:13208:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788940553.271190:0:13208:0:(obd_config.c:1048:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788940553.271196:0:13208:0:(genops.c:1827:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff89f1bf767800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788940553.271202:0:13208:0:(genops.c:1561:class_disconnect_exports()) OBD device 12 (ffff89f1bf868000) has exports, disconnecting them 00000020:00080000:0.0:1788940553.271207:0:13208:0:(genops.c:1536:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff89f1bf767800), last request at 1788940300 00000020:00000080:0.0:1788940553.271211:0:13208:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x27a633fcdd4a920 00000020:00080000:0.0:1788940553.271222:0:13208:0:(genops.c:1541:class_disconnect_export_list()) disconnected export at 0@lo (ffff89f1bf767800): rc 0 00000020:00000080:0.0:1788940553.271226:0:13208:0:(genops.c:893:class_export_put()) final put ffff89f1bf767800/lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1788940553.271889:0:13208:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788940553.271907:0:13208:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788940553.271911:0:13208:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788940553.271916:0:13208:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788940553.272037:0:13208:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788940553.272043:0:13208:0:(obd_config.c:958:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1788940553.272049:0:13208:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89f19016d800 1 00000020:00000080:0.0:1788940553.272054:0:13208:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x27a633fcdd4a8b0 00000020:00000080:0.0:1788940553.272059:0:13208:0:(genops.c:893:class_export_put()) final put ffff89f191e30800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1788940553.272063:0:13208:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1788940553.272066:0:13208:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788940553.272069:0:13208:0:(obd_config.c:1048:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788940553.272072:0:13208:0:(genops.c:1566:class_disconnect_exports()) OBD device 9 (ffff89f1b51833b0) has no exports 00000020:00000080:2.0:1788940553.273462:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1bf53a800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788940553.273482:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1bf767800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788940553.273492:0:36:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff89f1c1871000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788940553.273499:0:36:0:(genops.c:893:class_export_put()) final put ffff89f1ae71e000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1788940553.273502:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1ae71e000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1788940553.273506:0:36:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1788940553.273586:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffff89f191e30800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788940553.284552:0:13208:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788940553.284578:0:13208:0:(obd_config.c:958:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1788940553.284583:0:13208:0:(genops.c:893:class_export_put()) final put ffff89f191e30000/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1788940553.284588:0:13208:0:(genops.c:852:class_export_destroy()) destroying export ffff89f191e30000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1788940553.284595:0:13208:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1788940553.284724:0:13208:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff89f18873b000 00000020:02000400:2.0:1788940553.286883:0:13208:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00000100:00080000:1.0:1788940553.718927:0:36:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788940553.718938:0:36:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788940553.718943:0:36:0:(import.c:65:import_set_state_nolock()) ffff89f1b5042000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788940553.718953:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 491 00000100:00080000:1.0:1788940553.718959:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788940553.718966:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89f1b5042000 using connection 192.168.202.114@tcp/0@lo 00000100:00100000:1.0:1788940553.719013:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89f1baad5500 x1875839738278272/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788940553.719179:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1baad5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1875839738278272:0@lo:38:kworker.0 00000400:00000100:3.0:1788940553.719230:0:3304:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875839738278272 offset 0 length 520: 4 00010000:00010000:2.0:1788940553.974572:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940554.991758:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940556.012963:0:7649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788940556.936015:0:13359:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788940556.953776:0:13359:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1788940556.954315:0:13359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f082ad2200/0x27a633fcdd4aabd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4aac4 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940556.954336:0:13359:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f082ad2200/0x27a633fcdd4aabd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4aac4 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940556.954344:0:13359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f082ad2200/0x27a633fcdd4aabd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x27a633fcdd4aac4 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940556.954353:0:13359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.114@tcp lock: ffff89f082ad2200/0x27a633fcdd4aabd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x27a633fcdd4aac4 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940556.954386:0:13359:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788940556.954393:0:13359:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788940556.954427:0:13359:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788940556.954442:0:13359:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff89f1baad5500 x1875839738278272/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788940573 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940556.954459:0:13359:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788940556.954482:0:13359:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788940556.954490:0:13359:0:(import.c:65:import_set_state_nolock()) ffff89f1b5042000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1788940556.954496:0:13359:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788940556.954501:0:13359:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff89f1baad5500 x1875839738278272/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788940573 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940556.954508:0:13359:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788940556.954511:0:13359:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 22s for inflight to error out 00010000:00010000:3.0:1788940556.954563:0:7648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940556.954573:0:7648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff89f082ad2200/0x27a633fcdd4aabd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x27a633fcdd4aac4 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940556.954583:0:7648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad2200 already unused, calling callback (ffffffffc1d10c20) 10000000:00010000:3.0:1788940556.954587:0:7648:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff89f082ad2200/0x27a633fcdd4aabd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x27a633fcdd4aac4 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940556.954598:0:7648:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff89f082ad2200/0x27a633fcdd4aabd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x27a633fcdd4aac4 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788940556.954606:0:7648:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff89f082ad2200/0x27a633fcdd4aabd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x27a633fcdd4aac4 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940556.954627:0:7648:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788940556.954630:0:7648:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788940556.954633:0:7648:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788940556.954658:0:7648:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff89f1901ab800 00010000:00010000:3.0:1788940556.954663:0:7648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff89f082ad2200/0x27a633fcdd4aabd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x27a633fcdd4aac4 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940556.954671:0:7648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff89f082ad2200/0x27a633fcdd4aabd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x27a633fcdd4aac4 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940556.954684:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940556.954686:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940556.954688:0:7648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940556.954722:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1baad5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1875839738278272:0@lo:38:kworker.0 00010000:00010000:1.0:1788940556.957606:0:13359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f181520c00/0x27a633fcdd4aacb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4aad2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940556.957627:0:13359:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f181520c00/0x27a633fcdd4aacb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4aad2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940556.957635:0:13359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f181520c00/0x27a633fcdd4aacb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x27a633fcdd4aad2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940556.957643:0:13359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.114@tcp lock: ffff89f181520c00/0x27a633fcdd4aacb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x27a633fcdd4aad2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940556.957668:0:13359:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788940556.957676:0:13359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f180031000/0x27a633fcdd4ad02 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4ad09 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940556.957683:0:13359:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f180031000/0x27a633fcdd4ad02 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4ad09 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940556.957689:0:13359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f180031000/0x27a633fcdd4ad02 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x27a633fcdd4ad09 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940556.957696:0:13359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.114@tcp lock: ffff89f180031000/0x27a633fcdd4ad02 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x27a633fcdd4ad09 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940556.957747:0:13359:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788940556.957752:0:13359:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1788940556.957781:0:13359:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1788940556.957787:0:13359:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1788940556.957792:0:13359:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788940556.957799:0:13359:0:(obd_config.c:1048:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788940556.957804:0:13359:0:(genops.c:1566:class_disconnect_exports()) OBD device 15 (ffff89f198018000) has no exports 00010000:00010000:3.0:1788940556.957835:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788940556.957847:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff89f181520c00/0x27a633fcdd4aacb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x27a633fcdd4aad2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788940556.957849:0:13359:0:(genops.c:1566:class_disconnect_exports()) OBD device 15 (ffff89f198018000) has no exports 00010000:00010000:3.0:1788940556.957860:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f181520c00 already unused, calling callback (ffffffffc1d10c20) 10000000:00010000:3.0:1788940556.957865:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff89f181520c00/0x27a633fcdd4aacb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x27a633fcdd4aad2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940556.957878:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff89f181520c00/0x27a633fcdd4aacb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x27a633fcdd4aad2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788940556.957886:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff89f181520c00/0x27a633fcdd4aacb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x27a633fcdd4aad2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940556.957893:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788940556.957896:0:5849:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1788940556.957899:0:5849:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1788940556.957917:0:5849:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff89f1901ab800 00010000:00010000:3.0:1788940556.957922:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff89f181520c00/0x27a633fcdd4aacb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x27a633fcdd4aad2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940556.957939:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff89f181520c00/0x27a633fcdd4aacb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x27a633fcdd4aad2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940556.957955:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940556.957959:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff89f180031000/0x27a633fcdd4ad02 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x27a633fcdd4ad09 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940556.957965:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f180031000 already unused, calling callback (ffffffffc1d10c20) 10000000:00010000:3.0:1788940556.957968:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff89f180031000/0x27a633fcdd4ad02 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x27a633fcdd4ad09 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940556.957976:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff89f180031000/0x27a633fcdd4ad02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x27a633fcdd4ad09 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788940556.957982:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff89f180031000/0x27a633fcdd4ad02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x27a633fcdd4ad09 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940556.957989:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788940556.957991:0:5849:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788940556.957993:0:5849:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788940556.957999:0:5849:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff89f1901ab800 00010000:00010000:3.0:1788940556.958002:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff89f180031000/0x27a633fcdd4ad02 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x27a633fcdd4ad09 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940556.958009:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff89f180031000/0x27a633fcdd4ad02 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x27a633fcdd4ad09 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940556.958023:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940556.958024:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940556.958035:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940556.960392:0:7650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788940556.968526:0:13359:0:(lprocfs_status_server.c:371:lprocfs_free_client_stats()) stat ffff89f1a954e900 - data ffff89f1bfd4be58/ffff89f1bf707400 00000020:01000000:1.0:1788940556.968660:0:13359:0:(lprocfs_status_server.c:371:lprocfs_free_client_stats()) stat ffff89f08350d000 - data ffff89f1a9b87e58/ffff89f1aebf5000 00100000:10000000:3.0:1788940556.989093:0:13359:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788940557.015957:0:13359:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x27a633fcdd4a9c1 00000020:00000080:1.0:1788940557.015967:0:13359:0:(genops.c:893:class_export_put()) final put ffff89f1ba918800/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1788940557.015989:0:13359:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89f1bf721000 from lustre-OST0001, refs=2 00000020:01000004:1.0:1788940557.015993:0:13359:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89f1bf721000 2 00000020:01000004:1.0:1788940557.015996:0:13359:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff89f1bf721000 from lustre-OST0001 00000020:00000080:1.0:1788940557.016017:0:13359:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788940557.016027:0:13359:0:(obd_config.c:958:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1788940557.016029:0:13359:0:(genops.c:893:class_export_put()) final put ffff89f1bf722000/lustre-OST0001_UUID 00000020:00000080:1.0:1788940557.016032:0:13359:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1bf722000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1788940557.016040:0:13359:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1788940557.016184:0:13359:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import 1220f165-b68f-42ea-b6cd-5f8ad1a18830->MGS 00010000:00010000:1.0:1788940557.016201:0:13359:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff89f181520200/0x27a633fcdd4a8d3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x27a633fcdd4a8da expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788940557.016213:0:13359:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff89f181520200/0x27a633fcdd4a8d3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x27a633fcdd4a8da expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940557.016220:0:13359:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1788940557.016223:0:13359:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1788940557.016236:0:13359:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1788940557.016255:0:13359:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff89f1901ab800 00010000:00010000:1.0:1788940557.016259:0:13359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff89f181520200/0x27a633fcdd4a8d3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x27a633fcdd4a8da expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1788940557.016361:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1ba918800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00010000:00010000:1.0:1788940557.016676:0:13359:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff89f082ad3600/0x27a633fcdd4ab11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x27a633fcdd4ab18 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788940557.016685:0:13359:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff89f082ad3600/0x27a633fcdd4ab11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x27a633fcdd4ab18 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940557.016691:0:13359:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788940557.016693:0:13359:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1788940557.016695:0:13359:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1788940557.016706:0:13359:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff89f1901ab800 00010000:00010000:1.0:1788940557.016709:0:13359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff89f082ad3600/0x27a633fcdd4ab11 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x27a633fcdd4ab18 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788940557.016725:0:13359:0:(import.c:65:import_set_state_nolock()) ffff89f1901ab800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1788940557.016728:0:13359:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788940557.016731:0:13359:0:(pinger.c:194:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788940557.016732:0:13359:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788940557.016736:0:13359:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788940557.016746:0:13359:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff89f1ba976300 x1875839738278144/t0(0) o250->MGC192.168.202.114@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788940563 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788940557.016805:0:13359:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788940557.016808:0:13359:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00000100:00100000:3.0:1788940557.017052:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ba976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1220f165-b68f-42ea-b6cd-5f8ad1a18830:3304:1875839738278144:0@lo:250:ptlrpcd_00_02.0 10000000:01000000:1.0:1788940557.017190:0:13359:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788940557.017198:0:13359:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x27a633fcdd4a7b4 00000020:00000080:1.0:1788940557.017204:0:13359:0:(genops.c:893:class_export_put()) final put ffff89f1901ad800/1220f165-b68f-42ea-b6cd-5f8ad1a18830 00000020:01000000:1.0:1788940557.017220:0:13359:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of MGC192.168.202.114@tcp (flags='') 00000020:00000080:1.0:1788940557.017226:0:13359:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788940557.017237:0:13359:0:(obd_config.c:1048:class_cleanup()) MGC192.168.202.114@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788940557.017241:0:13359:0:(genops.c:1566:class_disconnect_exports()) OBD device 2 (ffff89f1982e0000) has no exports 00000020:00000080:2.0:1788940557.017290:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1901ad800/1220f165-b68f-42ea-b6cd-5f8ad1a18830 for MGC192.168.202.114@tcp 10000000:01000000:2.0:1788940557.017570:0:5858:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1788940557.017663:0:13359:0:(obd_class.h:676:obd_cleanup_client_import()) MGC192.168.202.114@tcp: client import never connected 00000100:00080000:1.0:1788940557.017667:0:13359:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1788940557.017669:0:13359:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788940557.017671:0:13359:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1788940557.017673:0:13359:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788940557.017716:0:13359:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788940557.017723:0:13359:0:(obd_config.c:958:class_detach()) detach on obd MGC192.168.202.114@tcp (uuid 1220f165-b68f-42ea-b6cd-5f8ad1a18830) 00000020:01000000:1.0:1788940557.017729:0:13359:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1788940557.017733:0:13359:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788940557.017737:0:13359:0:(obd_config.c:1048:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788940557.017743:0:13359:0:(genops.c:1827:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff89f1b5047800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788940557.017749:0:13359:0:(genops.c:1561:class_disconnect_exports()) OBD device 16 (ffff89f1bf86b3b0) has exports, disconnecting them 00000020:00080000:1.0:1788940557.017753:0:13359:0:(genops.c:1536:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff89f1b5047800), last request at 1788940320 00000020:00000080:1.0:1788940557.017758:0:13359:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x27a633fcdd4a9eb 00000020:00080000:1.0:1788940557.017768:0:13359:0:(genops.c:1541:class_disconnect_export_list()) disconnected export at 0@lo (ffff89f1b5047800): rc 0 00000020:00000080:1.0:1788940557.017772:0:13359:0:(genops.c:893:class_export_put()) final put ffff89f1b5047800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1788940557.018488:0:36:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff89f1901ab800 for MGC192.168.202.114@tcp 00000020:00000080:2.0:1788940557.018498:0:36:0:(genops.c:893:class_export_put()) final put ffff89f1901af800/1220f165-b68f-42ea-b6cd-5f8ad1a18830 00000020:00000080:2.0:1788940557.018501:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1901af800/1220f165-b68f-42ea-b6cd-5f8ad1a18830 for MGC192.168.202.114@tcp 00000020:01000000:2.0:1788940557.018507:0:36:0:(genops.c:443:class_free_dev()) finishing cleanup of obd MGC192.168.202.114@tcp (1220f165-b68f-42ea-b6cd-5f8ad1a18830) 00000020:00000080:2.0:1788940557.018787:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1b5047800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1788940557.033624:0:13359:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788940557.033634:0:13359:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788940557.033639:0:13359:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788940557.033648:0:13359:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788940557.035346:0:5848:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:3.0:1788940557.035493:0:36:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff89f1b5042000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:3.0:1788940557.035649:0:7649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1788940557.035766:0:7648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:3.0:1788940557.035895:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00010000:00010000:3.0:1788940557.036008:0:7650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-5 blwis in pool) 00000100:00100000:3.0:1788940557.036168:0:5844:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff89f19022ce00:5844] 1 exiting: rc = 0 00000100:00100000:3.0:1788940557.036218:0:8469:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff89f19005c000:8469] 2 exiting: rc = 0 00000100:00100000:1.0:1788940557.036451:0:8530:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_003: service thread [ffff89f1a9486e00:8530] 3 exiting: rc = 0 00000100:00100000:1.0:1788940557.054792:0:5843:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff89f1a02b4400:5843] 0 exiting: rc = 1 00000100:00100000:2.0:1788940557.055004:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.055614:0:5846:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff89f18401be00:5846] 1 exiting: rc = 0 00000100:00100000:3.0:1788940557.055678:0:5845:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff89f18401b400:5845] 0 exiting: rc = 1 00000100:00100000:1.0:1788940557.055877:0:8470:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff89f184157c00:8470] 3 exiting: rc = 0 00000100:00100000:1.0:1788940557.055945:0:5847:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff89f19000fe00:5847] 2 exiting: rc = 0 00000100:00100000:2.0:1788940557.056017:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940557.056026:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940557.056032:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940557.056038:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940557.056044:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940557.056050:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940557.056056:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940557.056062:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940557.056068:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940557.056074:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940557.056081:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940557.056098:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940557.056103:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940557.056109:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940557.056115:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940557.056120:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940557.056126:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940557.056143:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940557.056149:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940557.056154:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940557.056160:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940557.056164:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940557.056169:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940557.056174:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940557.056180:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940557.056185:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940557.056190:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940557.056195:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940557.056201:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940557.056206:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940557.056212:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940557.056217:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940557.056222:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940557.056227:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940557.056232:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940557.056237:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940557.056243:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940557.056248:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940557.056252:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940557.056257:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940557.056262:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940557.056267:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940557.056756:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940557.056766:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940557.056771:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940557.056776:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940557.056790:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940557.056796:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940557.056801:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940557.056806:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940557.056811:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940557.056815:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940557.056830:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940557.056836:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940557.056841:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940557.056846:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940557.056851:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940557.056856:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940557.056860:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940557.056867:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940557.056872:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940557.056877:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940557.056882:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940557.056887:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788940557.057780:0:13359:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788940557.057790:0:13359:0:(obd_config.c:958:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1788940557.057795:0:13359:0:(genops.c:893:class_export_put()) final put ffff89f1b5047000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1788940557.057799:0:13359:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1b5047000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1788940557.057809:0:13359:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:2.0:1788940557.057863:0:13359:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89f1bf721000 1 00000020:00000080:2.0:1788940557.057869:0:13359:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x27a633fcdd4a990 00000020:00000080:2.0:1788940557.057875:0:13359:0:(genops.c:893:class_export_put()) final put ffff89f1bf766800/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1788940557.057894:0:13359:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1788940557.057899:0:13359:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788940557.057904:0:13359:0:(obd_config.c:1048:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788940557.057908:0:13359:0:(genops.c:1566:class_disconnect_exports()) OBD device 14 (ffff89f1980199d8) has no exports 00000020:00000080:3.0:1788940557.057984:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1bf766800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1788940557.070016:0:13359:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788940557.070033:0:13359:0:(obd_config.c:958:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1788940557.070038:0:13359:0:(genops.c:893:class_export_put()) final put ffff89f1bf720000/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1788940557.070043:0:13359:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1bf720000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1788940557.070051:0:13359:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1788940557.071321:0:13359:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff89f1bf727000 00000020:01000000:3.0:1788940557.071347:0:13359:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1788940557.071353:0:13359:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788940557.071358:0:13359:0:(obd_config.c:1048:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788940557.071362:0:13359:0:(genops.c:1566:class_disconnect_exports()) OBD device 10 (ffff89f1b5184d88) has no exports 00000020:00000080:3.0:1788940557.071384:0:13359:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788940557.071392:0:13359:0:(obd_config.c:958:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1788940557.071396:0:13359:0:(genops.c:893:class_export_put()) final put ffff89f191e36800/OSS_uuid 00000020:00000080:3.0:1788940557.071399:0:13359:0:(genops.c:852:class_export_destroy()) destroying export ffff89f191e36800/OSS_uuid for OSS 00000020:01000000:3.0:1788940557.071403:0:13359:0:(genops.c:443:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1788940557.073060:0:6708:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff89f1b8871000:6708] 2 exiting: rc = 0 00000100:00100000:0.0:1788940557.073292:0:6707:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff89f186a06c00:6707] 1 exiting: rc = 0 00000100:00100000:0.0:1788940557.073347:0:12095:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff89f1ae81ae00:12095] 4 exiting: rc = 0 00000100:00100000:1.0:1788940557.073550:0:6705:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff89f1b8870000:6705] 0 exiting: rc = 1 00000100:00080000:2.0:1788940557.073761:0:5856:0:(pinger.c:603:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1788940557.073880:0:7074:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff89f1bf5f9800:7074] 3 exiting: rc = 0 00000100:00100000:3.0:1788940557.074151:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.074173:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.074180:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.074187:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.074192:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.074198:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.074203:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.074208:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.074213:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.074218:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.074222:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.074228:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.074232:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.074237:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.074243:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.074249:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.074254:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.074259:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.074264:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.074384:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.074392:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.074397:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.074402:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.074408:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.074414:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.074419:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.074425:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.074430:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.074436:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.074441:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.074446:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.074451:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.074457:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.074464:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.074469:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.074474:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.074488:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.074493:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.074498:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.074503:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.074508:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.074513:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.074552:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.074557:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.074562:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.074566:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.074570:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.074576:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.074580:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.074585:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.074590:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.074595:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.074600:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.074605:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.074610:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.074615:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.074619:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.074624:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.074629:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.074634:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.074640:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.074645:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.074649:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.074660:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940557.075904:0:12964:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff89f1b5016a00:12964] 2 exiting: rc = 0 00000100:00100000:1.0:1788940557.076046:0:6710:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff89f1b8871800:6710] 1 exiting: rc = 0 00000100:00100000:0.0:1788940557.076220:0:6709:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff89f1a955f200:6709] 0 exiting: rc = 1 00000100:00100000:3.0:1788940557.076481:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.076488:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.076494:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.076499:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.076505:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.076510:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.076742:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.076763:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.076768:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.076774:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.076779:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.076784:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.076789:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.076795:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.076800:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.076804:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.076809:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.076814:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.076829:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.076835:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.076840:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.076845:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.076850:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.076856:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.076861:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.076866:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.076872:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.076877:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.076882:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.076887:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.076893:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.076898:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.076905:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.076911:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.076916:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.076921:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.076926:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.076931:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.076936:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.076941:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.076947:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.076952:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.076964:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.076970:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.076975:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.076980:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.076986:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.076991:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.076995:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.077000:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.077005:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.077011:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.077019:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.077027:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.077034:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.077039:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.077044:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.077048:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.077054:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.077059:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.077064:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.077069:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.077074:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.077085:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.078023:0:6711:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff89f18dee5600:6711] 0 exiting: rc = 1 00000100:00100000:2.0:1788940557.078416:0:6713:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff89f1a025be00:6713] 2 exiting: rc = 0 00000100:00100000:2.0:1788940557.078613:0:6712:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff89f1a025a200:6712] 1 exiting: rc = 0 00000100:00100000:3.0:1788940557.079005:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.079013:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.079018:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.079024:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.079039:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.079046:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.079051:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.079057:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.079063:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.079069:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.079074:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.079079:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.079093:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.079098:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.079104:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.079109:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.079115:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.079120:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.079126:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.079140:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.079147:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.079164:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.079171:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.079177:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.079182:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.079187:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.079195:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.079200:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.079205:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.079211:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.079216:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.079222:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.079227:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.079232:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.079237:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.079243:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.079248:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.079254:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.079259:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.079265:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.079385:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.079402:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.079410:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.079415:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.079421:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.079426:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.079431:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.079444:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.079449:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.079455:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.079461:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.079466:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.079472:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.079477:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.079496:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.079511:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.079545:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.079552:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.079558:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.079564:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.079571:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.079577:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.079583:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.079596:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940557.085790:0:6714:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff89f1a025a400:6714] 0 exiting: rc = 1 00000100:00100000:2.0:1788940557.085895:0:6715:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff89f1b54cf200:6715] 1 exiting: rc = 0 00000100:00100000:3.0:1788940557.086094:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.086103:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.086108:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.086113:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.086119:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.086124:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.086139:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.086144:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.086150:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.086154:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.086160:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.086166:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.086223:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.086229:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.086233:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.086239:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.086243:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.086249:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.086270:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.086285:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.086292:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.086297:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.086326:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.086335:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.086340:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.086345:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.086349:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.086353:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.086358:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.086363:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.086367:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.086373:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.086377:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.086383:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.086388:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.086392:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.086397:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.086402:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.086406:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.086411:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.086417:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.086423:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.086428:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.086436:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.086459:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.086465:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.086471:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.086476:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.086485:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.086490:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.086497:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.086503:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.086508:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.086756:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.086762:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.086767:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.086773:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.086778:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.086783:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.086788:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.086793:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.086798:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.086802:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.086807:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940557.087940:0:6716:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff89f1b54ce400:6716] 0 exiting: rc = 1 00000100:00100000:1.0:1788940557.088434:0:6717:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff89f1b54cfa00:6717] 1 exiting: rc = 0 00000100:00100000:3.0:1788940557.088608:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.088625:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.088633:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.088638:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.088644:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.088649:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.088655:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.088661:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.088667:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.088673:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.088692:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.088699:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.088705:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.088712:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.088721:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.088727:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.088733:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.088739:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.088745:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.088751:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.088757:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.088763:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.088784:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.088791:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.088808:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.088815:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.088831:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.088838:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.088844:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.088851:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.088858:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.088864:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.088870:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.088876:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.088898:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.088905:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.088911:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.088918:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.088924:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.088931:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.088937:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.088944:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.088951:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.088958:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.088965:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.088971:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.088991:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.089000:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.089006:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.089013:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.089020:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.089026:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.089032:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.089038:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.089044:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.089050:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.089057:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.089063:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.089084:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.089100:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.089107:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.089114:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.089120:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940557.089239:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1788940557.117424:0:13359:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1788940574.894234:0:13976:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg214-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1788940585.472816:0:14436:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788940585.472826:0:14436:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1788940585.473084:0:14436:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff89f1b0c14800 00000020:01000004:0.0:1788940585.473114:0:14436:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1788940585.473127:0:14436:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788940585.473149:0:14436:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff89f1b5c7b3b0) 00000020:00000080:0.0:1788940585.473169:0:14436:0:(obd_config.c:786:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788940585.503704:0:14436:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1788940585.506331:0:14436:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:1.0:1788940585.507133:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 535: rc = 0 00100000:10000000:1.0:1788940585.507353:0:14436:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1788940585.507421:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 535: rc = 0 00100000:10000000:1.0:1788940585.507507:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 535: rc = 0 00100000:10000000:1.0:1788940585.507646:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 535: rc = 0 00100000:10000000:1.0:1788940585.507754:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 535: rc = 0 00100000:10000000:1.0:1788940585.507851:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 535: rc = 0 00100000:10000000:1.0:1788940585.508821:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 537: rc = 0 00100000:10000000:1.0:1788940585.510068:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 768: rc = 0 00100000:10000000:1.0:1788940585.510181:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 768: rc = 0 00100000:10000000:1.0:1788940585.510673:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 674: rc = 0 00100000:10000000:1.0:1788940585.511048:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 674: rc = 0 00100000:10000000:1.0:1788940585.511292:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 674: rc = 0 00100000:10000000:2.0:1788940585.516284:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 674: rc = 0 00100000:10000000:2.0:1788940585.516993:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 674: rc = 0 00100000:10000000:2.0:1788940585.517335:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 674: rc = 0 00100000:10000000:2.0:1788940585.519154:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 674: rc = 0 00100000:10000000:2.0:1788940585.519652:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 674: rc = 0 00100000:10000000:2.0:1788940585.520201:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 674: rc = 0 00100000:10000000:2.0:1788940585.521098:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 674: rc = 0 00100000:10000000:2.0:1788940585.521392:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 674: rc = 0 00100000:10000000:2.0:1788940585.522156:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 674: rc = 0 00100000:10000000:2.0:1788940585.522737:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 696: rc = 0 00100000:10000000:2.0:1788940585.523815:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 696: rc = 0 00100000:10000000:2.0:1788940585.524294:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 696: rc = 0 00100000:10000000:2.0:1788940585.524614:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 696: rc = 0 00100000:10000000:3.0:1788940585.525323:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 696: rc = 0 00100000:10000000:3.0:1788940585.525691:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 696: rc = 0 00100000:10000000:3.0:1788940585.526226:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 696: rc = 0 00100000:10000000:3.0:1788940585.526583:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 696: rc = 0 00100000:10000000:3.0:1788940585.529295:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 696: rc = 0 00100000:10000000:3.0:1788940585.529789:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 696: rc = 0 00100000:10000000:3.0:1788940585.532259:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 696: rc = 0 00100000:10000000:3.0:1788940585.532785:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 696: rc = 0 00100000:10000000:3.0:1788940585.533506:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 696: rc = 0 00100000:10000000:3.0:1788940585.535815:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 696: rc = 0 00100000:10000000:3.0:1788940585.536406:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 696: rc = 0 00100000:10000000:3.0:1788940585.536739:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 696: rc = 0 00100000:10000000:3.0:1788940585.538464:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 696: rc = 0 00100000:10000000:3.0:1788940585.538803:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 696: rc = 0 00100000:10000000:3.0:1788940585.539403:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 696: rc = 0 00100000:10000000:3.0:1788940585.539767:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 696: rc = 0 00100000:10000000:3.0:1788940585.540295:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 696: rc = 0 00100000:10000000:3.0:1788940585.540598:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 696: rc = 0 00100000:10000000:3.0:1788940585.540839:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 696: rc = 0 00100000:10000000:3.0:1788940585.541367:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 696: rc = 0 00100000:10000000:3.0:1788940585.541769:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 696: rc = 0 00100000:10000000:3.0:1788940585.542589:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 696: rc = 0 00100000:10000000:3.0:1788940585.542907:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 696: rc = 0 00100000:10000000:3.0:1788940585.543466:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 696: rc = 0 00100000:10000000:3.0:1788940585.543773:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 696: rc = 0 00100000:10000000:3.0:1788940585.544251:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 696: rc = 0 00100000:10000000:3.0:1788940585.544549:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 696: rc = 0 00100000:10000000:3.0:1788940585.544822:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 696: rc = 0 00100000:10000000:3.0:1788940585.546181:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 41: rc = 0 00100000:10000000:3.0:1788940585.546755:0:14436:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1788940585.546926:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 769: rc = 0 00100000:10000000:3.0:1788940585.547125:0:14436:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1788940585.547194:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 769: rc = 0 00100000:10000000:3.0:1788940585.547405:0:14436:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1788940585.547469:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 769: rc = 0 00100000:10000000:3.0:1788940585.547891:0:14436:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1788940585.547965:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 540: rc = 0 00100000:10000000:3.0:1788940585.548152:0:14436:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1788940585.548215:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 540: rc = 0 00100000:10000000:3.0:1788940585.557641:0:14436:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1788940585.557784:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 540: rc = 0 00000020:00000080:2.0:1788940585.562503:0:14436:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788940585.562534:0:14436:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788940585.562549:0:14436:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x27a633fcdd4bab5 00000020:01000004:2.0:1788940585.562571:0:14436:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788940585.562577:0:14436:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788940585.562585:0:14436:0:(tgt_mount.c:101:server_register_mount()) register mount ffff89f1b0c14800 from MGS 00000020:01000004:2.0:1788940585.562590:0:14436:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788940585.562608:0:14436:0:(genops.c:415:class_newdev()) Allocate new device MGS (ffff89f1980199d8) 00000020:00000080:2.0:1788940585.562624:0:14436:0:(obd_config.c:786:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788940585.562705:0:14436:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89f1b0c14800 from MGS, refs=2 00080000:01000000:2.0:1788940585.562711:0:14436:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788940585.562734:0:14436:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x27a633fcdd4bac3 00000100:00100000:2.0:1788940585.566185:0:14436:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788940585.566446:0:14436:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788940585.566454:0:14436:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788940585.570202:0:14436:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788940585.570222:0:14436:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788940585.585297:0:14436:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788940585.588981:0:14436:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788940585.589001:0:14436:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788940585.599771:0:14436:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788940585.599792:0:14436:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788940585.601109:0:14436:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788940585.601124:0:14436:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788940585.607945:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940585.607955:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940585.607957:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940585.609236:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940585.609241:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940585.609244:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940585.610069:0:14436:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788940585.612719:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788940585.659600:0:14436:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1788940585.659632:0:14436:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788940585.659636:0:14436:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1788940585.661570:0:14445:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1788940585.661755:0:14436:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1788940585.663403:0:14436:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788940585.664173:0:14436:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788940585.664616:0:14436:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788940585.664838:0:14436:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788940585.664846:0:14436:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788940585.677151:0:14436:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788940585.677168:0:14436:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788940585.677713:0:14436:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788940585.677721:0:14436:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:3.0:1788940585.690669:0:14450:0:(pinger.c:501:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:0.0:1788940585.690776:0:14436:0:(obd_config.c:900:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788940585.690801:0:14436:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.114@tcp' 00000020:01000004:0.0:1788940585.690803:0:14436:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788940585.690836:0:14436:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.114@tcp (typ=mgc) 00000020:00000080:0.0:1788940585.690864:0:14436:0:(genops.c:415:class_newdev()) Allocate new device MGC192.168.202.114@tcp (ffff89f1b5c78000) 00000020:00000080:0.0:1788940585.690886:0:14436:0:(obd_config.c:786:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788940585.690983:0:14436:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89f1b5c5e800@MGC192.168.202.114@tcp: add connection 192.168.202.114@tcp at head 00010000:00010000:0.0:1788940585.691172:0:14436:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.114@tcp-0 is initialized 00000040:01000000:0.0:1788940585.691179:0:14436:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.114@tcp ctxt 1 is initialized 10000000:01000000:0.0:1788940585.691678:0:14451:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788940585.691710:0:14436:0:(obd_config.c:900:class_setup()) finished setup of obd MGC192.168.202.114@tcp (uuid 0f4fd945-1ad9-4c6a-9448-c9b3792aa94f) 00000020:00000080:0.0:1788940585.691729:0:14436:0:(genops.c:1393:class_connect()) connect: client 0f4fd945-1ad9-4c6a-9448-c9b3792aa94f, cookie 0x27a633fcdd4bad1 00000100:00080000:0.0:1788940585.691744:0:14436:0:(import.c:545:import_select_connection()) MGC192.168.202.114@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788940585.691751:0:14436:0:(import.c:665:import_select_connection()) MGC192.168.202.114@tcp: import ffff89f1b5c5e800 using connection 192.168.202.114@tcp/0@lo 00000100:00100000:0.0:1788940585.691797:0:14436:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89f083eddf80 x1875839738278400/t0(0) o250->MGC192.168.202.114@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788940585.691824:0:14436:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import 0f4fd945-1ad9-4c6a-9448-c9b3792aa94f->MGS 00000020:01000004:0.0:1788940585.691847:0:14436:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788940585.692030:0:14436:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788940585.692044:0:14436:0:(genops.c:415:class_newdev()) Allocate new device MDS (ffff89f1b5c7cd88) 00000020:00000080:0.0:1788940585.692056:0:14436:0:(obd_config.c:786:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1788940585.692639:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f083eddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3304:1875839738278400:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788940585.692740:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940585.694690:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738278400 00000100:00100000:2.0:1788940585.694708:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738278400 00000100:00100000:2.0:1788940585.694761:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788940585.694771:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf59d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3304:x1875839738278400:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1788940585.694806:0:14446:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 0f4fd945-1ad9-4c6a-9448-c9b3792aa94f@0@lo t0 exp 0000000000000000 cur 528 last 0 00000020:00000080:2.0:1788940585.694848:0:14446:0:(genops.c:1393:class_connect()) connect: client 0f4fd945-1ad9-4c6a-9448-c9b3792aa94f, cookie 0x27a633fcdd4badf 00000100:00080000:2.0:1788940585.699720:0:14446:0:(import.c:65:import_set_state_nolock()) ffff89f1834b0000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788940585.700418:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf59d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+5:3304:x1875839738278400:12345-0@lo:250:mount.lustre.0 Request processed in 5638us (7669us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940585.700438:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788940585.701127:0:3304:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.114@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788940585.701148:0:3304:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.202.114@tcp: connect to target with instance 0 00000100:00080000:2.0:1788940585.701164:0:3304:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.202.114@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788940585.701173:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788940585.701179:0:3304:0:(import.c:65:import_set_state_nolock()) ffff89f1b5c5e800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788940585.701183:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788940585.701207:0:3304:0:(pinger.c:187:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788940585.701217:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f083eddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3304:1875839738278400:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788940585.717879:0:14436:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788940585.718147:0:14436:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788940585.718155:0:14436:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788940585.735755:0:14436:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788940585.735780:0:14436:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788940585.737105:0:14436:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788940585.737119:0:14436:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788940585.740455:0:14436:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788940585.744349:0:14436:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788940585.744363:0:14436:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788940585.746143:0:14436:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788940585.746162:0:14436:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788940585.861139:0:14436:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788940585.862239:0:14436:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788940585.862250:0:14436:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788940585.864075:0:14436:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788940585.864095:0:14436:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788940585.865415:0:14436:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788940585.866025:0:14436:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788940585.866035:0:14436:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788940585.869362:0:14436:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788940585.869491:0:14436:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788940585.870826:0:14436:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788940585.871339:0:14436:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788940585.871348:0:14436:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788940585.872377:0:14436:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788940585.872390:0:14436:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788940585.874411:0:14436:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788940585.876270:0:14436:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788940585.876283:0:14436:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788940585.884415:0:14436:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788940585.884442:0:14436:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788940585.947251:0:14436:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788940585.947575:0:14436:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788940585.947585:0:14436:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788940585.952450:0:14436:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788940585.952474:0:14436:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788940585.961026:0:14436:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788940585.961051:0:14436:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788940585.963239:0:14436:0:(obd_config.c:900:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788940585.963356:0:14436:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1788940585.963365:0:14436:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.114@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788940585.964111:0:14436:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.114@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788940585.964163:0:14436:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.114@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788940585.964168:0:14436:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788940585.964170:0:14436:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788940585.964171:0:14436:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788940585.964173:0:14436:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788940585.964174:0:14436:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788940585.964175:0:14436:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788940585.964176:0:14436:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788940585.964178:0:14436:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788940585.964180:0:14436:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788940585.964181:0:14436:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788940585.964185:0:14436:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788940585.964187:0:14436:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788940585.964188:0:14436:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788940585.964193:0:14436:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788940585.964194:0:14436:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788940585.964195:0:14436:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788940585.964196:0:14436:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788940585.964197:0:14436:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788940585.964198:0:14436:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788940585.964199:0:14436:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788940585.964199:0:14436:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788940585.964235:0:14436:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788940585.964265:0:14436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4c24000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14436:1875839738278528:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788940585.964430:0:14436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940585.964619:0:14436:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f187c03f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788940585.984623:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738278528 00000100:00100000:3.0:1788940585.984641:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738278528 00000100:00100000:3.0:1788940585.984749:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788940585.984764:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf59f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+5:14436:x1875839738278528:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788940585.984816:0:14449:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788940585.984819:0:14449:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788940585.984822:0:14449:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1788940585.991422:0:14470:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788940585.993926:0:14449:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1788940585.998115:0:14471:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1788940585.998768:0:14471:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1788940585.998772:0:14471:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1788940585.999308:0:14471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1788940586.000231:0:14449:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788940586.000254:0:14449:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788940586.020276:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf59f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+5:14436:x1875839738278528:12345-0@lo:253:mount.lustre.0 Request processed in 35501us (55829us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940586.020297:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788940586.024373:0:14436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4c24000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14436:1875839738278528:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788940586.024402:0:14436:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788940586.024406:0:14436:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788940586.024431:0:14436:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788940586.024433:0:14436:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788940586.024434:0:14436:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788940586.024435:0:14436:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788940586.024437:0:14436:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788940586.024438:0:14436:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788940586.024439:0:14436:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788940586.024441:0:14436:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788940586.024443:0:14436:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788940586.024472:0:14436:0:(tgt_mount.c:101:server_register_mount()) register mount ffff89f1b0c14800 from lustre-MDT0000 10000000:01000000:0.0:1788940586.024508:0:14436:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788940586.024511:0:14436:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788940586.024646:0:14436:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff89f1b5c78000 10000000:01000000:0.0:1788940586.024653:0:14436:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788940586.024665:0:14436:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff89f1b5c78000 from 1 10000000:01000000:0.0:1788940586.024669:0:14436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788940586.024728:0:14436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f082ad2000/0x27a633fcdd4bae6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940586.024743:0:14436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f082ad2000/0x27a633fcdd4bae6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940586.024755:0:14436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f082ad2000/0x27a633fcdd4bae6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940586.024784:0:14436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f083edd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14436:1875839738278656:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788940586.024873:0:14436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940586.025209:0:14436:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f18dedbd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788940586.031807:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738278656 00000100:00100000:0.0:1788940586.031827:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738278656 00000100:00100000:0.0:1788940586.034088:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788940586.034136:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf59dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+5:14436:x1875839738278656:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788940586.034171:0:14448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940586.034228:0:14448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f082ad3200/0x27a633fcdd4baed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4bae6 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940586.034277:0:14448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f082ad3200/0x27a633fcdd4baed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4bae6 expref: 6 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940586.034294:0:14448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f082ad3200/0x27a633fcdd4baed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4bae6 expref: 6 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940586.034306:0:14448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f082ad3200, rc 0) 00000100:00100000:0.0:1788940586.034454:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf59dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+6:14436:x1875839738278656:12345-0@lo:101:mount.lustre.0 Request processed in 345us (9581us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940586.034463:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788940586.034673:0:14436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f083edd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14436:1875839738278656:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788940586.034699:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f082ad2000/0x27a633fcdd4bae6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4baed expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940586.034709:0:14436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f082ad2000/0x27a633fcdd4bae6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4baed expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940586.034824:0:14436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4c27100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14436:1875839738278784:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788940586.034869:0:14436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940586.042309:0:14436:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f187c03d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788940586.045208:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738278784 00000100:00100000:2.0:1788940586.045228:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738278784 00000100:00100000:2.0:1788940586.045312:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788940586.045323:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf59e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+6:14436:x1875839738278784:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788940586.045754:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf59e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+6:14436:x1875839738278784:12345-0@lo:501:mount.lustre.0 Request processed in 430us (10882us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788940586.045764:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788940586.047238:0:14436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4c27100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14436:1875839738278784:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788940586.047298:0:14436:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788940586.047341:0:14436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f082ad2000/0x27a633fcdd4bae6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4baed expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940586.047355:0:14436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f082ad2000/0x27a633fcdd4bae6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4baed expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940586.047367:0:14436:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff89f1b0c14800 10000000:01000000:3.0:1788940586.047378:0:14436:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788940586.047384:0:14436:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff89f1b0c14800 10000000:01000000:3.0:1788940586.047387:0:14436:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788940586.047391:0:14436:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff89f1b0c14800 from 1 10000000:01000000:3.0:1788940586.047395:0:14436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788940586.047443:0:14436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f1bfa96000/0x27a633fcdd4baf4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940586.047453:0:14436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f1bfa96000/0x27a633fcdd4baf4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940586.047467:0:14436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f1bfa96000/0x27a633fcdd4baf4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940586.047495:0:14436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4c27100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14436:1875839738278912:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788940586.047626:0:14436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940586.047668:0:14436:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f187c03d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788940586.049063:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738278912 00000100:00100000:0.0:1788940586.049082:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738278912 00000100:00100000:0.0:1788940586.049167:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788940586.049182:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf59c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+6:14436:x1875839738278912:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788940586.049203:0:14448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940586.049227:0:14448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f082ad3c00/0x27a633fcdd4bafb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4baf4 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940586.049263:0:14448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f082ad3c00/0x27a633fcdd4bafb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4baf4 expref: 7 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940586.049276:0:14448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f082ad3c00/0x27a633fcdd4bafb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4baf4 expref: 7 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940586.049286:0:14448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f082ad3c00, rc 0) 00000100:00100000:0.0:1788940586.049369:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf59c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+7:14436:x1875839738278912:12345-0@lo:101:mount.lustre.0 Request processed in 191us (1743us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940586.049399:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788940586.049719:0:14436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4c27100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14436:1875839738278912:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788940586.049742:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f1bfa96000/0x27a633fcdd4baf4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4bafb expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940586.049754:0:14436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f1bfa96000/0x27a633fcdd4baf4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4bafb expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940586.049774:0:14436:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788940586.049779:0:14436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f1bfa96000/0x27a633fcdd4baf4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4bafb expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940586.049787:0:14436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f1bfa96000/0x27a633fcdd4baf4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4bafb expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940586.049795:0:14436:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788940586.049802:0:14436:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788940586.049808:0:14436:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff89f1b0c14800 10000000:01000000:3.0:1788940586.049811:0:14436:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788940586.049815:0:14436:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788940586.049818:0:14436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788940586.049847:0:14436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97e00/0x27a633fcdd4bb02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940586.049855:0:14436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97e00/0x27a633fcdd4bb02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940586.049865:0:14436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97e00/0x27a633fcdd4bb02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940586.049900:0:14436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4c27100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14436:1875839738279040:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788940586.049942:0:14436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940586.049980:0:14436:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f187c03d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788940586.050113:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738279040 00000100:00100000:2.0:1788940586.050125:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738279040 00000100:00100000:2.0:1788940586.050154:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788940586.050161:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf59d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+7:14436:x1875839738279040:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788940586.050169:0:14446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940586.050181:0:14446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f188dabe00/0x27a633fcdd4bb09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4bb02 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940586.050198:0:14446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f188dabe00/0x27a633fcdd4bb09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4bb02 expref: 8 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940586.050207:0:14446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f188dabe00/0x27a633fcdd4bb09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4bb02 expref: 8 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940586.050214:0:14446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f188dabe00, rc 0) 00000100:00100000:2.0:1788940586.050256:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf59d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+8:14436:x1875839738279040:12345-0@lo:101:mount.lustre.0 Request processed in 95us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940586.050261:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788940586.050335:0:14436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4c27100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14436:1875839738279040:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788940586.050346:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97e00/0x27a633fcdd4bb02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4bb09 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940586.050353:0:14436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97e00/0x27a633fcdd4bb02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4bb09 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940586.050406:0:14436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4c27100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14436:1875839738279168:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788940586.050430:0:14436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940586.050452:0:14436:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f187c03d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788940586.050503:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738279168 00000100:00100000:2.0:1788940586.050507:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738279168 00000100:00100000:2.0:1788940586.050580:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788940586.050588:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf59cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+8:14436:x1875839738279168:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788940586.051331:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf59cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+9:14436:x1875839738279168:12345-0@lo:501:mount.lustre.0 Request processed in 740us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940586.051341:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788940586.051463:0:14436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4c27100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14436:1875839738279168:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788940586.051509:0:14436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4c27100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14436:1875839738279296:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788940586.051611:0:14436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940586.051638:0:14436:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f187c03d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788940586.051713:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738279296 00000100:00100000:0.0:1788940586.051720:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738279296 00000100:00100000:0.0:1788940586.051754:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788940586.051762:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf59c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+9:14436:x1875839738279296:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788940586.052224:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf59c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+9:14436:x1875839738279296:12345-0@lo:503:mount.lustre.0 Request processed in 461us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940586.052233:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788940586.052349:0:14436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4c27100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14436:1875839738279296:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788940586.052942:0:14472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4c27100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14472:1875839738279424:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788940586.052996:0:14472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940586.053116:0:14472:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f187c03000 going to sleep for 11 seconds 00000100:00100000:0.0:1788940586.054074:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738279424 00000100:00100000:0.0:1788940586.054089:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738279424 00000100:00100000:0.0:1788940586.054198:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788940586.054209:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf59d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+9:14472:x1875839738279424:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788940586.054644:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf59d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+9:14472:x1875839738279424:12345-0@lo:502:llog_process_th.0 Request processed in 436us (1646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940586.054652:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788940586.054803:0:14472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4c27100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14472:1875839738279424:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788940586.054841:0:14472:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788940586.054864:0:14472:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940586.054867:0:14472:0:(obd_config.c:1662:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788940586.054876:0:14472:0:(obd_config.c:2066:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788940586.054880:0:14472:0:(obd_config.c:1571:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788940586.054903:0:14472:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff89f1bf8699d8) 00000020:00000080:3.0:1788940586.054934:0:14472:0:(obd_config.c:786:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788940586.054941:0:14472:0:(obd_config.c:1571:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788940586.055060:0:14472:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788940586.055077:0:14472:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x27a633fcdd4bb17 00000020:00000080:3.0:1788940586.055360:0:14472:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788940586.055365:0:14472:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788940586.055369:0:14472:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940586.055370:0:14472:0:(obd_config.c:1662:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788940586.055373:0:14472:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788940586.055376:0:14472:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940586.055378:0:14472:0:(obd_config.c:1662:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788940586.055380:0:14472:0:(obd_config.c:1571:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788940586.055389:0:14472:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0000 (ffff89f1bf86b3b0) 00000020:00000080:3.0:1788940586.055400:0:14472:0:(obd_config.c:786:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788940586.055403:0:14472:0:(obd_config.c:1571:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788940586.055406:0:14472:0:(obd_config.c:1615:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788940586.055409:0:14472:0:(obd_config.c:1248:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788940586.055414:0:14472:0:(obd_config.c:1571:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788940586.055479:0:14472:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89f1b0c14800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788940586.055494:0:14472:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDD0000 (ffff89f1bf868000) 00000020:00000080:3.0:1788940586.055502:0:14472:0:(obd_config.c:786:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788940586.055600:0:14472:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788940586.055607:0:14472:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x27a633fcdd4bb2c 00000020:00000080:3.0:1788940586.055706:0:14472:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788940586.055712:0:14472:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788940586.055717:0:14472:0:(genops.c:1393:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x27a633fcdd4bb33 00080000:01000000:3.0:1788940586.055721:0:14472:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788940586.055724:0:14472:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x27a633fcdd4bb3a 00010000:00010000:2.0:1788940586.262556:0:14472:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1788940586.291942:0:14472:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967527 00000001:00080000:0.0:1788940586.292243:0:14472:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788940586.292980:0:14472:0:(genops.c:415:class_newdev()) Allocate new device lustre-QMT0000 (ffff89f1b5c799d8) 00000020:00000080:0.0:1788940586.293001:0:14472:0:(obd_config.c:786:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1788940586.293074:0:14472:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788940586.293082:0:14472:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x27a633fcdd4bb48 00000020:00000080:0.0:1788940586.300088:0:14472:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788940586.325622:0:14472:0:(genops.c:1393:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x27a633fcdd4bb4f 00000020:00000080:1.0:1788940586.333383:0:14472:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788940586.333400:0:14472:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788940586.333409:0:14472:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940586.333411:0:14472:0:(obd_config.c:1662:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788940586.333415:0:14472:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788940586.333422:0:14472:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940586.333424:0:14472:0:(obd_config.c:1662:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788940586.333430:0:14472:0:(obd_config.c:1571:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788940586.333484:0:14472:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788940586.333507:0:14472:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788940586.333510:0:14472:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940586.333567:0:14472:0:(obd_config.c:1662:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1788940586.333572:0:14472:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788940586.333574:0:14472:0:(obd_config.c:2001:class_config_llog_handler()) SKIP #10 00000020:01000000:1.0:1788940586.333576:0:14472:0:(obd_config.c:2027:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788940586.333577:0:14472:0:(obd_config.c:2027:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788940586.333579:0:14472:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788940586.333582:0:14472:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940586.333584:0:14472:0:(obd_config.c:1662:class_process_config()) marker 10 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788940586.333587:0:14472:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788940586.333592:0:14472:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788940586.333596:0:14472:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940586.333597:0:14472:0:(obd_config.c:1662:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788940586.333601:0:14472:0:(obd_config.c:1571:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788940586.333650:0:14472:0:(obd_config.c:1586:class_process_config()) adding mapping from uuid 192.168.202.114@tcp to nid 0x20000c0a8ca72 (192.168.202.114@tcp) 00000020:01000000:1.0:1788940586.333683:0:14472:0:(obd_config.c:2073:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788940586.333686:0:14472:0:(obd_config.c:1571:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788940586.333704:0:14472:0:(genops.c:415:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff89f1b5184d88) 00000020:00000080:1.0:1788940586.333724:0:14472:0:(obd_config.c:786:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1788940586.333730:0:14472:0:(obd_config.c:1571:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788940586.333786:0:14472:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788940586.333791:0:14472:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788940586.333798:0:14472:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x27a633fcdd4bb5d 00010000:00080000:1.0:1788940586.333833:0:14472:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89f194b4f800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.114@tcp at head 00010000:00010000:1.0:1788940586.334092:0:14472:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1788940586.334755:0:14472:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788940586.334804:0:14472:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788940586.339883:0:14472:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788940586.339973:0:14472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1788940586.340047:0:14472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1788940586.342403:0:14476:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788940586.342412:0:14476:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788940586.344190:0:14472:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788940586.344220:0:14472:0:(obd_config.c:1571:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788940586.344259:0:14472:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788940586.344280:0:14472:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x27a633fcdd4bb64 00000100:00080000:1.0:1788940586.344292:0:14472:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788940586.344298:0:14472:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff89f194b4f800 using connection 192.168.202.114@tcp/0@lo 00000100:00100000:1.0:1788940586.344343:0:14472:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89f1baad5f80 x1875839738279552/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788940586.347147:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1baad5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875839738279552:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788940586.347208:0:3304:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875839738279552 offset 0 length 520: 4 00000100:00080000:0.0:1788940586.347342:0:14472:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788940586.347427:0:14472:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788940586.347433:0:14472:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940586.347435:0:14472:0:(obd_config.c:1662:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788940586.347447:0:14472:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788940586.347450:0:14472:0:(obd_config.c:2001:class_config_llog_handler()) SKIP #15 00000020:01000000:0.0:1788940586.347451:0:14472:0:(obd_config.c:2027:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788940586.347452:0:14472:0:(obd_config.c:2027:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788940586.347453:0:14472:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788940586.347455:0:14472:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940586.347456:0:14472:0:(obd_config.c:1662:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788940586.347458:0:14472:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788940586.347462:0:14472:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788940586.347464:0:14472:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940586.347465:0:14472:0:(obd_config.c:1662:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788940586.347466:0:14472:0:(obd_config.c:1571:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788940586.347470:0:14472:0:(obd_config.c:1586:class_process_config()) adding mapping from uuid 192.168.202.114@tcp to nid 0x20000c0a8ca72 (192.168.202.114@tcp) 00000020:01000000:0.0:1788940586.347490:0:14472:0:(obd_config.c:2073:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788940586.347491:0:14472:0:(obd_config.c:1571:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788940586.347508:0:14472:0:(genops.c:415:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff89f1982e0000) 00000020:00000080:0.0:1788940586.347544:0:14472:0:(obd_config.c:786:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1788940586.347558:0:14472:0:(obd_config.c:1571:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788940586.347814:0:14472:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788940586.347820:0:14472:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788940586.347828:0:14472:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x27a633fcdd4bb72 00010000:00080000:1.0:1788940586.347857:0:14472:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89f192361800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.114@tcp at head 00010000:00010000:1.0:1788940586.348077:0:14472:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1788940586.348277:0:14472:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788940586.348299:0:14472:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788940586.350754:0:14472:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788940586.350870:0:14472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1788940586.350950:0:14472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:0.0:1788940586.351801:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788940586.351821:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ba976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3307:1875839738279680:0@lo:400:kworker.0 00000100:00100000:0.0:1788940586.351907:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940586.352481:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738279680 00000100:00100000:2.0:1788940586.352503:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738279680 00000100:00100000:2.0:1788940586.352613:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788940586.352622:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf59f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+9:3307:x1875839738279680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940586.352691:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf59f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+9:3307:x1875839738279680:12345-0@lo:400:kworker.0 Request processed in 69us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940586.352698:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788940586.353096:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ba976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3307:1875839738279680:0@lo:400:kworker.0 00000040:00080000:0.0:1788940586.355884:0:14478:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788940586.355893:0:14478:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788940586.358142:0:14472:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788940586.358159:0:14472:0:(obd_config.c:1571:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788940586.358201:0:14472:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788940586.358843:0:14472:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x27a633fcdd4bb79 00000100:00080000:1.0:1788940586.358860:0:14472:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788940586.358866:0:14472:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff89f192361800 using connection 192.168.202.114@tcp/0@lo 00000100:00100000:1.0:1788940586.358913:0:14472:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89f1baad4700 x1875839738279808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788940586.358945:0:14472:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1788940586.359033:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1baad4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875839738279808:0@lo:8:llog_process_th.0 00000020:01000000:1.0:1788940586.359041:0:14472:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788940586.359045:0:14472:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940586.359047:0:14472:0:(obd_config.c:1662:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788940586.359059:0:14472:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788940586.359063:0:14472:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940586.359064:0:14472:0:(obd_config.c:1662:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788940586.359067:0:14472:0:(obd_config.c:1571:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788940586.359069:0:14472:0:(obd_config.c:1636:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788940586.359071:0:14472:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788940586.359072:0:14472:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940586.359074:0:14472:0:(obd_config.c:1662:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788940586.359076:0:14472:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788940586.359077:0:14472:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940586.359079:0:14472:0:(obd_config.c:1662:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788940586.359082:0:14472:0:(obd_config.c:1571:class_process_config()) processing cmd: cf00f 00000400:00000100:2.0:1788940586.359089:0:3304:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875839738279808 offset 0 length 520: 4 00000100:00100000:1.0:1788940586.359111:0:14472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1baad4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14472:1875839738279936:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788940586.359170:0:14472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940586.359197:0:14472:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1ae807240 going to sleep for 11 seconds 00000100:00100000:0.0:1788940586.359315:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738279936 00000100:00100000:0.0:1788940586.359322:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738279936 00000100:00100000:0.0:1788940586.359384:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788940586.359394:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf59f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+9:14472:x1875839738279936:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788940586.359901:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf59f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+9:14472:x1875839738279936:12345-0@lo:502:llog_process_th.0 Request processed in 507us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940586.359910:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788940586.360062:0:14472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1baad4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14472:1875839738279936:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788940586.360091:0:14472:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788940586.360096:0:14472:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940586.360098:0:14472:0:(obd_config.c:1662:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788940586.360102:0:14472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1788940586.360281:0:14436:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1788940586.360303:0:14436:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788940586.360326:0:14436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97e00/0x27a633fcdd4bb02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4bb09 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940586.360338:0:14436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97e00/0x27a633fcdd4bb02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4bb09 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940586.360346:0:14436:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff89f1b0c14800 from 1 10000000:01000000:2.0:1788940586.360349:0:14436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788940586.360392:0:14436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f188daa600/0x27a633fcdd4bb80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940586.360400:0:14436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f188daa600/0x27a633fcdd4bb80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940586.360409:0:14436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f188daa600/0x27a633fcdd4bb80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940586.360425:0:14436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ba974e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14436:1875839738280064:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788940586.360463:0:14436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940586.360493:0:14436:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1baa6a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788940586.360599:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738280064 00000100:00100000:0.0:1788940586.360605:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738280064 00000100:00100000:0.0:1788940586.360676:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788940586.360686:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf59fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+9:14436:x1875839738280064:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788940586.360697:0:14448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940586.360711:0:14448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f082ad3e00/0x27a633fcdd4bb87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4bb80 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940586.360734:0:14448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f082ad3e00/0x27a633fcdd4bb87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4bb80 expref: 10 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940586.360745:0:14448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f082ad3e00/0x27a633fcdd4bb87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4bb80 expref: 10 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940586.360754:0:14448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f082ad3e00, rc 0) 00000100:00100000:0.0:1788940586.360788:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf59fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+10:14436:x1875839738280064:12345-0@lo:101:mount.lustre.0 Request processed in 105us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940586.360794:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788940586.361317:0:14436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ba974e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14436:1875839738280064:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788940586.361334:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f188daa600/0x27a633fcdd4bb80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4bb87 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940586.361343:0:14436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f188daa600/0x27a633fcdd4bb80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4bb87 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940586.362189:0:14436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4c27100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14436:1875839738280192:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788940586.362242:0:14436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940586.362398:0:14436:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1b4c129c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940586.362606:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738280192 00000100:00100000:2.0:1788940586.362613:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738280192 00000100:00100000:3.0:1788940586.362757:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788940586.362764:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b546f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+10:14436:x1875839738280192:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788940586.362782:0:14446:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788940586.362788:0:14446:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788940586.362854:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b546f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+10:14436:x1875839738280192:12345-0@lo:256:mount.lustre.0 Request processed in 89us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940586.362861:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788940586.362901:0:14436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4c27100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14436:1875839738280192:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788940586.363575:0:14436:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788940586.363594:0:14436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f188daa600/0x27a633fcdd4bb80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4bb87 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940586.363605:0:14436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f188daa600/0x27a633fcdd4bb80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4bb87 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940586.363612:0:14436:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89f1b0c14800 from 1 10000000:01000000:3.0:1788940586.365886:0:14436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788940586.365962:0:14436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97200/0x27a633fcdd4bb8e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940586.365976:0:14436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97200/0x27a633fcdd4bb8e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940586.365991:0:14436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97200/0x27a633fcdd4bb8e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940586.366027:0:14436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4c27100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14436:1875839738280320:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788940586.366121:0:14436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940586.366178:0:14436:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1b4c129c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940586.366218:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738280320 00000100:00100000:2.0:1788940586.366234:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738280320 00000100:00100000:3.0:1788940586.368725:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788940586.368745:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b546d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+10:14436:x1875839738280320:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788940586.368773:0:14446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940586.368807:0:14446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f1bfa96600/0x27a633fcdd4bb95 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4bb8e expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940586.368846:0:14446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f1bfa96600/0x27a633fcdd4bb95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4bb8e expref: 11 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940586.368859:0:14446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f1bfa96600/0x27a633fcdd4bb95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4bb8e expref: 11 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940586.368870:0:14446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f1bfa96600, rc 0) 00000100:00100000:3.0:1788940586.370631:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b546d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+11:14436:x1875839738280320:12345-0@lo:101:mount.lustre.0 Request processed in 1876us (4495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940586.370647:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788940586.373773:0:14436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4c27100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14436:1875839738280320:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788940586.373822:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97200/0x27a633fcdd4bb8e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4bb95 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940586.373838:0:14436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97200/0x27a633fcdd4bb8e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4bb95 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940586.391111:0:14436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4c27b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14436:1875839738280448:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788940586.391215:0:14436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940586.391276:0:14436:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1b4c129c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788940586.391338:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738280448 00000100:00100000:1.0:1788940586.391353:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738280448 00000100:00100000:1.0:1788940586.391439:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788940586.391449:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b546c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+11:14436:x1875839738280448:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788940586.391932:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b546c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+11:14436:x1875839738280448:12345-0@lo:501:mount.lustre.0 Request processed in 483us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940586.391940:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788940586.392807:0:14436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4c27b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14436:1875839738280448:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788940586.392870:0:14436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f083edc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14436:1875839738280576:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788940586.392922:0:14436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940586.392975:0:14436:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1b347e600 going to sleep for 11 seconds 00000100:00100000:2.0:1788940586.392997:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738280576 00000100:00100000:2.0:1788940586.393013:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738280576 00000100:00100000:2.0:1788940586.393679:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788940586.393694:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b546d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+11:14436:x1875839738280576:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788940586.394962:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b546d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+11:14436:x1875839738280576:12345-0@lo:503:mount.lustre.0 Request processed in 1264us (2031us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940586.394976:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788940586.395255:0:14436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f083edc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14436:1875839738280576:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788940586.396367:0:14480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ba976680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14480:1875839738280704:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788940586.396911:0:14480:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940586.396998:0:14480:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1baa6a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788940586.397327:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738280704 00000100:00100000:3.0:1788940586.397339:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738280704 00000100:00100000:3.0:1788940586.397742:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788940586.397756:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b546fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+11:14480:x1875839738280704:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788940586.398165:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b546fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+11:14480:x1875839738280704:12345-0@lo:502:llog_process_th.0 Request processed in 412us (1254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940586.398176:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788940586.398289:0:14480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ba976680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14480:1875839738280704:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788940586.398346:0:14480:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788940586.398358:0:14480:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940586.398361:0:14480:0:(obd_config.c:1662:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788940586.398379:0:14480:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: general-ffff89f1b0c14800 00000020:00000080:2.0:1788940586.398383:0:14480:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788940586.398409:0:14480:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788940586.398412:0:14480:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940586.398414:0:14480:0:(obd_config.c:1662:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788940586.398417:0:14480:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788940586.398427:0:14480:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940586.398429:0:14480:0:(obd_config.c:1662:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788940586.398433:0:14480:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: general-ffff89f1b0c14800 00000020:00000080:2.0:1788940586.398435:0:14480:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788940586.398542:0:14480:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788940586.398557:0:14480:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940586.398558:0:14480:0:(obd_config.c:1662:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788940586.398562:0:14480:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788940586.398564:0:14480:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940586.398565:0:14480:0:(obd_config.c:1662:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788940586.398569:0:14480:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff89f1b0c14800 00000020:00000080:2.0:1788940586.398571:0:14480:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788940586.398634:0:14480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ba976680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14480:1875839738280832:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788940586.398687:0:14480:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940586.405735:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738280832 00000100:00100000:1.0:1788940586.405762:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738280832 00000100:00100000:1.0:1788940586.405834:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788940586.405856:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b546e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+11:14480:x1875839738280832:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788940586.406205:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b546e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+11:14480:x1875839738280832:12345-0@lo:502:llog_process_th.0 Request processed in 352us (7517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940586.406215:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788940586.412210:0:14480:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1baa6a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940586.412276:0:14480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ba976680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14480:1875839738280832:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788940586.412338:0:14480:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788940586.412890:0:14480:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940586.412895:0:14480:0:(obd_config.c:1662:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788940586.412902:0:14480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788940586.413671:0:14436:0:(obd_config.c:2244:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788940586.413707:0:14436:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788940586.413734:0:14436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97200/0x27a633fcdd4bb8e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4bb95 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940586.414593:0:14436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97200/0x27a633fcdd4bb8e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4bb95 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940586.414670:0:14436:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788940586.414673:0:14436:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff89f1b0c14800 10000000:01000000:0.0:1788940586.414677:0:14436:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff89f1b0c14800 10000000:01000000:0.0:1788940586.414682:0:14436:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788940586.414690:0:14436:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff89f1b0c14800 from 1 10000000:01000000:0.0:1788940586.414693:0:14436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788940586.414745:0:14436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f082ad3800/0x27a633fcdd4bb9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940586.414753:0:14436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f082ad3800/0x27a633fcdd4bb9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940586.414766:0:14436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f082ad3800/0x27a633fcdd4bb9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940586.414796:0:14436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f083edc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14436:1875839738280960:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788940586.414888:0:14436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940586.414940:0:14436:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f195ed3b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788940586.416514:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738280960 00000100:00100000:2.0:1788940586.416561:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738280960 00000100:00100000:2.0:1788940586.416647:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788940586.416659:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b546c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+11:14436:x1875839738280960:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788940586.416682:0:14446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940586.416714:0:14446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f188daa800/0x27a633fcdd4bba3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4bb9c expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940586.416753:0:14446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f188daa800/0x27a633fcdd4bba3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4bb9c expref: 12 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940586.416766:0:14446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f188daa800/0x27a633fcdd4bba3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4bb9c expref: 12 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940586.416776:0:14446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f188daa800, rc 0) 00000100:00100000:2.0:1788940586.416875:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b546c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+12:14436:x1875839738280960:12345-0@lo:101:mount.lustre.0 Request processed in 218us (1988us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940586.416883:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788940586.417602:0:14436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f083edc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14436:1875839738280960:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788940586.417630:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f082ad3800/0x27a633fcdd4bb9c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4bba3 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940586.417643:0:14436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f082ad3800/0x27a633fcdd4bb9c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4bba3 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940586.417751:0:14436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f083edc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14436:1875839738281088:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788940586.417805:0:14436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940586.417849:0:14436:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f195ed3b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788940586.418136:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738281088 00000100:00100000:2.0:1788940586.418143:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738281088 00000100:00100000:2.0:1788940586.418184:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788940586.418194:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b546ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+12:14436:x1875839738281088:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788940586.420976:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b546ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+12:14436:x1875839738281088:12345-0@lo:501:mount.lustre.0 Request processed in 2768us (3155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940586.420995:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788940586.421726:0:14436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f083edc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14436:1875839738281088:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788940586.421799:0:14436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f083edc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14436:1875839738281216:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788940586.421871:0:14436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940586.421916:0:14436:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f195ed3b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788940586.422697:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738281216 00000100:00100000:2.0:1788940586.422710:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738281216 00000100:00100000:2.0:1788940586.422776:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788940586.422789:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b546cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+12:14436:x1875839738281216:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788940586.423087:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b546cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+12:14436:x1875839738281216:12345-0@lo:503:mount.lustre.0 Request processed in 301us (1216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940586.423097:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788940586.423384:0:14436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f083edc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14436:1875839738281216:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788940586.428251:0:14484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4c26a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14484:1875839738281344:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788940586.429175:0:14484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940586.429233:0:14484:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1b4c129c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940586.429666:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738281344 00000100:00100000:2.0:1788940586.429692:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738281344 00000100:00100000:2.0:1788940586.429754:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788940586.429766:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b546d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+12:14484:x1875839738281344:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788940586.430123:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b546d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+12:14484:x1875839738281344:12345-0@lo:502:llog_process_th.0 Request processed in 358us (950us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940586.430132:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788940586.431688:0:14484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4c26a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14484:1875839738281344:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1788940586.431805:0:14484:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788940586.431827:0:14484:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff89f1bf86cd88) 00000020:00000080:3.0:1788940586.431857:0:14484:0:(obd_config.c:786:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1788940586.431972:0:14484:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89f1b0c14800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788940586.431978:0:14484:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89f1b0c14800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788940586.431980:0:14484:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89f1b0c14800 4 00010000:00080000:3.0:1788940586.432020:0:14484:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89f1bf53c000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.114@tcp at head 00010000:00010000:2.0:1788940586.441981:0:14484:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1788940586.442281:0:14484:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788940586.442342:0:14484:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788940586.442374:0:14484:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x27a633fcdd4bbb1 00000100:00080000:2.0:1788940586.442390:0:14484:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788940586.442400:0:14484:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff89f1bf53c000 using connection 192.168.202.114@tcp/0@lo 00000100:00100000:2.0:1788940586.446651:0:14484:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89f1ba976680 x1875839738281472/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788940586.446725:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ba976680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875839738281472:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788940586.446848:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788940586.446928:0:14484:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788940586.450590:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738281472 00000100:00100000:1.0:1788940586.450612:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738281472 00000100:00100000:1.0:1788940586.450685:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788940586.450696:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ba974380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1875839738281472:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788940586.450834:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ba974380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1875839738281472:12345-0@lo:38:llog_process_th.0 Request processed in 137us (3986us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788940586.450843:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788940586.450908:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788940586.451553:0:3304:0:(import.c:65:import_set_state_nolock()) ffff89f1bf53c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788940586.451561:0:3304:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788940586.451567:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ba976680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875839738281472:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788940586.454992:0:14484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ba977100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14484:1875839738281600:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788940586.455128:0:14484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940586.455189:0:14484:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1baa6a600 going to sleep for 11 seconds 00000100:00100000:3.0:1788940586.455869:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738281600 00000100:00100000:3.0:1788940586.455882:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738281600 00000100:00100000:3.0:1788940586.455950:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788940586.455963:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b546f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+12:14484:x1875839738281600:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788940586.456302:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b546f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+12:14484:x1875839738281600:12345-0@lo:502:llog_process_th.0 Request processed in 341us (1173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940586.456319:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788940586.456877:0:14484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ba977100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14484:1875839738281600:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788940586.456931:0:14484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788940586.461466:0:14436:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1788940586.461534:0:14436:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788940586.461573:0:14436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f082ad3800/0x27a633fcdd4bb9c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4bba3 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940586.461592:0:14436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f082ad3800/0x27a633fcdd4bb9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4bba3 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788940586.461677:0:14436:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788940586.461679:0:14436:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788940586.461681:0:14436:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788940586.461682:0:14436:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788940586.461684:0:14436:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788940586.461685:0:14436:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788940586.461687:0:14436:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788940586.461689:0:14436:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788940586.461691:0:14436:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788940586.461692:0:14436:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788940586.461697:0:14436:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1788940586.461700:0:14436:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788940586.461701:0:14436:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788940586.461702:0:14436:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788940586.461704:0:14436:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788940586.461705:0:14436:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788940586.461706:0:14436:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788940586.461707:0:14436:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788940586.461708:0:14436:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788940586.461710:0:14436:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788940586.461711:0:14436:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788940586.461825:0:14436:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788940586.461854:0:14436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4c26a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14436:1875839738281728:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788940586.461965:0:14436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940586.462019:0:14436:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1b0c92a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788940586.463598:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738281728 00000100:00100000:3.0:1788940586.463617:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738281728 00000100:00100000:3.0:1788940586.463686:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788940586.463698:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b546c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+12:14436:x1875839738281728:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788940586.463747:0:14448:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788940586.463769:0:14448:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788940586.524727:0:14448:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788940586.524777:0:14448:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788940586.525292:0:14470:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788940586.525299:0:14470:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788940586.525330:0:14470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89f19258c800/0x27a633fcdd4bbb8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940586.525358:0:14470:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89f082ad3e00/0x27a633fcdd4bb87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4bb80 expref: 12 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940586.525368:0:14470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89f19258c800/0x27a633fcdd4bbb8 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940586.525873:0:14470:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89f082ad3e00/0x27a633fcdd4bb87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27a633fcdd4bb80 expref: 12 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940586.525912:0:14470:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89f082ad3e00/0x27a633fcdd4bb87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27a633fcdd4bb80 expref: 12 pid: 14448 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940586.525932:0:14470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1baad4a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14470:1875839738281856:0@lo:104: 00000100:00100000:1.0:1788940586.526239:0:14470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940586.526347:0:14470:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f18dea0240 going to sleep for 11 seconds 00000100:00100000:1.0:1788940586.527188:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738281856 00000100:00100000:1.0:1788940586.527201:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738281856 00000100:00100000:1.0:1788940586.527322:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788940586.527335:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1baad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+3:14470:x1875839738281856:12345-0@lo:104: 00010000:00010000:1.0:1788940586.527358:0:14437:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff89f188daa600/0x27a633fcdd4bb80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4bb87 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940586.527472:0:14437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788940586.527479:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1baad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+3:14470:x1875839738281856:12345-0@lo:104: Request processed in 147us (1240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940586.527488:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788940586.527806:0:14470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1baad4a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14470:1875839738281856:0@lo:104: 00010000:00010000:1.0:1788940586.527838:0:14470:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89f19258c800/0x27a633fcdd4bbb8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940586.527842:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940586.527855:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff89f188daa600/0x27a633fcdd4bb80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4bb87 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940586.527865:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188daa600 already unused, calling callback (ffffffffc1d10c20) 10000000:00010000:2.0:1788940586.527871:0:14443:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff89f188daa600/0x27a633fcdd4bb80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x27a633fcdd4bb87 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940586.527902:0:14443:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff89f188daa600/0x27a633fcdd4bb80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x27a633fcdd4bb87 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788940586.527911:0:14443:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff89f188daa600/0x27a633fcdd4bb80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x27a633fcdd4bb87 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940586.527918:0:14443:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788940586.527968:0:14443:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff89f188daa600/0x27a633fcdd4bb80 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4bb87 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940586.527977:0:14443:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788940586.528016:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff89f188daa600/0x27a633fcdd4bb80 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4bb87 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940586.528025:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff89f188daa600/0x27a633fcdd4bb80 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4bb87 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940586.528049:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940586.528051:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940586.528052:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940586.528146:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788940586.528162:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ba977800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3306:1875839738281984:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788940586.528217:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940586.528473:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738281984 00000100:00100000:2.0:1788940586.528480:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738281984 00010000:00010000:2.0:1788940586.528511:0:14439:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89f082ad3e00/0x27a633fcdd4bb87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4bb80 expref: 13 pid: 14448 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940586.528775:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788940586.528787:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f083edc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+13:3306:x1875839738281984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788940586.528806:0:14439:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940586.528814:0:14439:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89f082ad3e00/0x27a633fcdd4bb87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4bb80 expref: 13 pid: 14448 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940586.528841:0:14439:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89f082ad3e00/0x27a633fcdd4bb87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27a633fcdd4bb80 expref: 13 pid: 14448 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940586.528859:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f082ad3e00/0x27a633fcdd4bb87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27a633fcdd4bb80 expref: 13 pid: 14448 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940586.528876:0:14439:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89f19258c800/0x27a633fcdd4bbb8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940586.528885:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f19258c800/0x27a633fcdd4bbb8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788940586.528904:0:14439:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003605066s 00010000:00010000:2.0:1788940586.528910:0:14439:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89f19258c800/0x27a633fcdd4bbb8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940586.528920:0:14439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89f19258c800/0x27a633fcdd4bbb8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940586.528928:0:14439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89f19258c800/0x27a633fcdd4bbb8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940586.528935:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89f19258c800/0x27a633fcdd4bbb8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940586.528941:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258c800 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:2.0:1788940586.528946:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89f19258c800/0x27a633fcdd4bbb8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940586.528955:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89f19258c800/0x27a633fcdd4bbb8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940586.528988:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89f19258c800/0x27a633fcdd4bbb8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940586.529007:0:14439:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788940586.529014:0:14470:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89f19258c800/0x27a633fcdd4bbb8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940586.529034:0:14470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89f19258c800/0x27a633fcdd4bbb8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940586.529041:0:14470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f19258c800/0x27a633fcdd4bbb8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940586.529065:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f083edc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+12:3306:x1875839738281984:12345-0@lo:103:ldlm_bl.0 Request processed in 279us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940586.529074:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788940586.529119:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ba977800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3306:1875839738281984:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788940586.536096:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b546c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+11:14436:x1875839738281728:12345-0@lo:253:mount.lustre.0 Request processed in 72386us (74117us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940586.536116:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788940586.536222:0:14436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4c26a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14436:1875839738281728:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788940586.536242:0:14436:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788940586.536246:0:14436:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788940586.536248:0:14436:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788940586.536250:0:14436:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788940586.536251:0:14436:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788940586.536252:0:14436:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788940586.536254:0:14436:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788940586.536255:0:14436:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788940586.536257:0:14436:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788940586.536259:0:14436:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788940586.536261:0:14436:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788940586.536284:0:14436:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788940586.540973:0:14436:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1788940586.541179:0:14436:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788940586.548852:0:14436:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1788940586.549056:0:14436:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788940586.555939:0:14436:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1788940586.559401:0:14436:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1788940586.561007:0:14436:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1788940586.562302:0:14436:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1788940586.562800:0:14436:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1788940586.563330:0:14436:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1788940586.563786:0:14436:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1788940586.563943:0:14436:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:0.0:1788940586.601715:0:14436:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1788940586.604991:0:14436:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1788940586.605815:0:14494:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:0.0:1788940586.605960:0:14494:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788940586.614671:0:14494:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788940586.614818:0:14494:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788940586.614824:0:14494:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00080000:3.0:1788940586.620743:0:14493:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1788940586.620756:0:14493:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1788940586.622983:0:14436:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788940586.630127:0:14436:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788940586.631287:0:14436:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788940586.631442:0:14436:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788940586.631883:0:14436:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788940586.635503:0:14436:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788940586.636925:0:14436:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788940586.637070:0:14436:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:1.0:1788940586.640453:0:14436:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:1.0:1788940586.650767:0:14436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:3.0:1788940586.675983:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788940586.704755:0:14436:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788940586.704811:0:14436:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff98fc41c93988 00100000:10000000:2.0:1788940586.704822:0:14436:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 10000000:01000000:3.0:1788940586.708729:0:14451:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788940586.708744:0:14451:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff89f1b0c14800 from 6 10000000:01000000:3.0:1788940586.708754:0:14451:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788940586.708832:0:14451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97c00/0x27a633fcdd4bbbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940586.708878:0:14451:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97c00/0x27a633fcdd4bbbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940586.708895:0:14451:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97c00/0x27a633fcdd4bbbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940586.708935:0:14451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4c26a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14451:1875839738282112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788940586.709039:0:14451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940586.709126:0:14451:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1b0c92f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788940586.709341:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738282112 00000100:00100000:2.0:1788940586.709354:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738282112 00000100:00100000:2.0:1788940586.709436:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788940586.709450:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b546e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+11:14451:x1875839738282112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788940586.709469:0:14446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940586.709487:0:14446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f188daa600/0x27a633fcdd4bbc6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4bbbf expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940586.709568:0:14446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f188daa600/0x27a633fcdd4bbc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4bbbf expref: 12 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940586.709583:0:14446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f188daa600/0x27a633fcdd4bbc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4bbbf expref: 12 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940586.709611:0:14446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f188daa600, rc 0) 00000100:00100000:2.0:1788940586.709669:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b546e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+12:14451:x1875839738282112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 221us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940586.709676:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788940586.709788:0:14451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4c26a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14451:1875839738282112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788940586.709806:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97c00/0x27a633fcdd4bbbf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4bbc6 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940586.709824:0:14451:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97c00/0x27a633fcdd4bbbf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4bbc6 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940586.709888:0:14451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f083edd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14451:1875839738282240:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788940586.709925:0:14451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940586.709961:0:14451:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1863fa9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940586.710392:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738282240 00000100:00100000:2.0:1788940586.710399:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738282240 00000100:00100000:2.0:1788940586.710440:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788940586.710449:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b546f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+12:14451:x1875839738282240:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788940586.710467:0:14448:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788940586.710493:0:14448:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788940586.710498:0:14448:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1788940586.710640:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b546f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+12:14451:x1875839738282240:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 191us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940586.710648:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788940586.710687:0:14451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f083edd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14451:1875839738282240:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788940586.710736:0:14451:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788940586.710744:0:14451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97c00/0x27a633fcdd4bbbf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4bbc6 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940586.710755:0:14451:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97c00/0x27a633fcdd4bbbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4bbc6 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788940586.714487:0:14436:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788940586.714513:0:14436:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.114@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788940586.714566:0:14436:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788940586.714599:0:14436:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:1.0:1788940587.501826:0:14488:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788940587.693308:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788940588.526867:0:14488:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788940588.727573:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940589.741820:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940590.764856:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788940591.597002:0:37:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788940591.597012:0:37:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788940591.597015:0:37:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788940591.597019:0:37:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788940591.597022:0:37:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788940591.597027:0:37:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788940591.597032:0:37:0:(import.c:65:import_set_state_nolock()) ffff89f1bf53c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788940591.597052:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff89f1bf53c000 using connection 192.168.202.114@tcp/0@lo 00000100:00100000:3.0:1788940591.597085:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89f1b4c25880 x1875839738282496/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788940591.597124:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788940591.597147:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4c25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3305:1875839738282368:0@lo:400:kworker.0 00000100:00100000:3.0:1788940591.597263:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940591.597351:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4c25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875839738282496:0@lo:38:kworker.0 00000100:00100000:3.0:1788940591.597392:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940591.597456:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738282368 00000100:00100000:3.0:1788940591.597467:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738282368 00000100:00100000:3.0:1788940591.597566:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788940591.597577:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1c181f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+12:3305:x1875839738282368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940591.597848:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1c181f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+12:3305:x1875839738282368:12345-0@lo:400:kworker.0 Request processed in 59us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940591.597858:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788940591.597935:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4c25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3305:1875839738282368:0@lo:400:kworker.0 00000100:00100000:3.0:1788940591.598196:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738282496 00000100:00100000:3.0:1788940591.598205:0:14456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738282496 00000100:00100000:3.0:1788940591.598247:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788940591.598257:0:14456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4c26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3304:x1875839738282496:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788940591.598292:0:14456:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 534 last 0 00000020:00000080:3.0:1788940591.598344:0:14456:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x27a633fcdd4bbcd 00000004:00100000:3.0:1788940591.598367:0:14456:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788940591.598581:0:14456:0:(import.c:65:import_set_state_nolock()) ffff89f1bf538000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788940591.599192:0:14456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4c26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875839738282496:12345-0@lo:38:kworker.0 Request processed in 931us (1795us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940591.599201:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788940591.599926:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff89f1b4c25880 x1875839738282496/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788940601 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788940591.599948:0:3304:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788940591.599969:0:3304:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788940591.599975:0:3304:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788940591.599978:0:3304:0:(import.c:65:import_set_state_nolock()) ffff89f1bf53c000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788940591.599986:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4c25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875839738282496:0@lo:38:kworker.0 00010000:00010000:0.0:1788940591.791146:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788940592.776453:0:14737:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg214-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788940592.812727:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940593.839239:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940594.861007:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940595.892719:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788940596.713897:0:14888:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffded52b650 20000000:00000080:1.0:1788940596.713923:0:14888:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff89f1bbf0e800 uarg=0000000000000000 20000000:01000000:1.0:1788940596.713973:0:14888:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788940596.713983:0:14888:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788940596.713989:0:14888:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000100:00080000:3.0:1788940596.718564:0:36:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788940596.718573:0:36:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788940596.718576:0:36:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788940596.718580:0:36:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788940596.718621:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4c25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875839738282752:0@lo:400:kworker.0 00000100:00100000:0.0:1788940596.718673:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4c25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3307:1875839738282624:0@lo:400:kworker.0 00000100:00100000:1.0:1788940596.718827:0:3304:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788940586/real 1788940586] req@ffff89f1baad4700 x1875839738279808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788940596 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940596.718855:0:3304:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff89f1baad4700 x1875839738279808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788940596 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940596.718874:0:3304:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788940586/real 1788940586] req@ffff89f1baad5f80 x1875839738279552/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788940596 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940596.718888:0:3304:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff89f1baad5f80 x1875839738279552/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788940596 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788940596.718909:0:3304:0:(import.c:65:import_set_state_nolock()) ffff89f192361800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788940596.718922:0:3304:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788940596.718927:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1baad4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875839738279808:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788940596.718933:0:3304:0:(import.c:65:import_set_state_nolock()) ffff89f194b4f800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788940596.718938:0:3304:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788940596.718942:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1baad5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875839738279552:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788940596.718968:0:36:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788940596.718972:0:36:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788940596.718975:0:36:0:(import.c:65:import_set_state_nolock()) ffff89f194b4f800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788940596.718980:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 529 00000100:00080000:1.0:1788940596.718987:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788940596.718995:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff89f194b4f800 using connection 192.168.202.114@tcp/0@lo 00000100:00100000:1.0:1788940596.719020:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89f1baad5f80 x1875839738282880/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788940596.719034:0:36:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788940596.719038:0:36:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788940596.719039:0:36:0:(import.c:65:import_set_state_nolock()) ffff89f192361800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788940596.719043:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 529 00000100:00080000:1.0:1788940596.719052:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788940596.719057:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff89f192361800 using connection 192.168.202.114@tcp/0@lo 00000100:00100000:1.0:1788940596.719070:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89f1baad4700 x1875839738283008/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788940596.719088:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1baad5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875839738282880:0@lo:8:kworker.0 00000100:00100000:3.0:1788940596.729631:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940596.730073:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738282752 00000100:00100000:2.0:1788940596.730087:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738282752 00000100:00100000:2.0:1788940596.730153:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788940596.730167:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4c25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875839738282752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940596.730280:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4c25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875839738282752:12345-0@lo:400:kworker.0 Request processed in 117us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940596.730289:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788940596.730358:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff89f1b4c25f80 x1875839738282752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940612 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940596.730387:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4c25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875839738282752:0@lo:400:kworker.0 00000100:00100000:0.0:1788940596.734211:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940596.734290:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738282624 00000100:00100000:0.0:1788940596.734304:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738282624 00000100:00100000:0.0:1788940596.734403:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788940596.734415:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1c181ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+12:3307:x1875839738282624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940596.734771:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1c181ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+12:3307:x1875839738282624:12345-0@lo:400:kworker.0 Request processed in 346us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940596.734790:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000400:00000100:1.0:1788940596.734853:0:3304:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875839738282880 offset 0 length 520: 4 00000100:00100000:0.0:1788940596.734936:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4c25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3307:1875839738282624:0@lo:400:kworker.0 00000040:00080000:2.0:1788940596.738076:0:14889:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:3.0:1788940596.738721:0:14888:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 00000100:00100000:1.0:1788940596.743556:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1baad4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875839738283008:0@lo:8:kworker.0 00000400:00000100:1.0:1788940596.744305:0:3304:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875839738283008 offset 0 length 520: 4 10000000:01000000:3.0:1788940596.759931:0:14888:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788940596.760142:0:14888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89f188daba00/0x27a633fcdd4bbd4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940596.760171:0:14888:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89f1bfa96600/0x27a633fcdd4bb95 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4bb8e expref: 11 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940596.760181:0:14888:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89f188daba00/0x27a633fcdd4bbd4 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940596.760247:0:14888:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89f1bfa96600/0x27a633fcdd4bb95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27a633fcdd4bb8e expref: 11 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940596.760270:0:14888:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89f1bfa96600/0x27a633fcdd4bb95 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27a633fcdd4bb8e expref: 11 pid: 14446 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940596.760290:0:14888:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ba977800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14888:1875839738283136:0@lo:104: 00000100:00100000:2.0:1788940596.760387:0:14888:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940596.760470:0:14888:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f19103dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788940596.760572:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738283136 00000100:00100000:1.0:1788940596.760584:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738283136 00000100:00100000:1.0:1788940596.760650:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788940596.760663:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ba975f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+3:14888:x1875839738283136:12345-0@lo:104: 00010000:00010000:1.0:1788940596.760682:0:14437:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97200/0x27a633fcdd4bb8e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4bb95 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940596.760766:0:14437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788940596.760773:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ba975f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+3:14888:x1875839738283136:12345-0@lo:104: Request processed in 113us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940596.760781:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788940596.761398:0:14888:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ba977800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14888:1875839738283136:0@lo:104: 00010000:00010000:2.0:1788940596.761431:0:14888:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89f188daba00/0x27a633fcdd4bbd4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940596.762820:0:14442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940596.762838:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97200/0x27a633fcdd4bb8e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4bb95 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940596.762853:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1bfa97200 already unused, calling callback (ffffffffc1d10c20) 10000000:00010000:3.0:1788940596.762858:0:14442:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97200/0x27a633fcdd4bb8e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x27a633fcdd4bb95 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940596.762872:0:14442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97200/0x27a633fcdd4bb8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x27a633fcdd4bb95 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788940596.762880:0:14442:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97200/0x27a633fcdd4bb8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x27a633fcdd4bb95 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940596.762887:0:14442:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788940596.762966:0:14442:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97200/0x27a633fcdd4bb8e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4bb95 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940596.762974:0:14442:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788940596.763005:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97200/0x27a633fcdd4bb8e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4bb95 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940596.763013:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97200/0x27a633fcdd4bb8e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4bb95 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940596.763041:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940596.763043:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940596.763045:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940596.764624:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788940596.764673:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4c27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3306:1875839738283264:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788940596.764778:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940596.765918:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738283264 00000100:00100000:2.0:1788940596.765935:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738283264 00010000:00010000:2.0:1788940596.765989:0:14439:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89f1bfa96600/0x27a633fcdd4bb95 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4bb8e expref: 12 pid: 14446 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940596.766041:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788940596.766053:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4c24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+12:3306:x1875839738283264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788940596.766071:0:14439:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940596.766078:0:14439:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89f1bfa96600/0x27a633fcdd4bb95 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4bb8e expref: 12 pid: 14446 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940596.766093:0:14439:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89f1bfa96600/0x27a633fcdd4bb95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27a633fcdd4bb8e expref: 12 pid: 14446 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940596.766118:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f1bfa96600/0x27a633fcdd4bb95 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27a633fcdd4bb8e expref: 12 pid: 14446 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940596.766136:0:14439:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89f188daba00/0x27a633fcdd4bbd4 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940596.766147:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f188daba00/0x27a633fcdd4bbd4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940596.766168:0:14439:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89f188daba00/0x27a633fcdd4bbd4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940596.766176:0:14439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89f188daba00/0x27a633fcdd4bbd4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940596.766199:0:14439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89f188daba00/0x27a633fcdd4bbd4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940596.766206:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89f188daba00/0x27a633fcdd4bbd4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940596.766213:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188daba00 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:2.0:1788940596.766218:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89f188daba00/0x27a633fcdd4bbd4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940596.766227:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89f188daba00/0x27a633fcdd4bbd4 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940596.766243:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89f188daba00/0x27a633fcdd4bbd4 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940596.766257:0:14439:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940596.766343:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4c24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+11:3306:x1875839738283264:12345-0@lo:103:ldlm_bl.0 Request processed in 291us (1564us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940596.766351:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788940596.766496:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4c27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3306:1875839738283264:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788940596.766736:0:14888:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89f188daba00/0x27a633fcdd4bbd4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940596.766747:0:14888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89f188daba00/0x27a633fcdd4bbd4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940596.766754:0:14888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f188daba00/0x27a633fcdd4bbd4 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940596.913299:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940597.936228:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788940598.700686:0:14451:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788940598.700698:0:14451:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89f1b0c14800 from 10 10000000:01000000:2.0:1788940598.700705:0:14451:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788940598.700783:0:14451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f188daa000/0x27a633fcdd4bbdb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940598.700798:0:14451:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f188daa000/0x27a633fcdd4bbdb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940598.700813:0:14451:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f188daa000/0x27a633fcdd4bbdb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940598.700868:0:14451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ba977800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14451:1875839738283392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788940598.700986:0:14451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940598.701065:0:14451:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1841b36c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788940598.701187:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738283392 00000100:00100000:1.0:1788940598.701199:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738283392 00000100:00100000:1.0:1788940598.701279:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788940598.701290:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1c181c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+11:14451:x1875839738283392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788940598.701308:0:14449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940598.701328:0:14449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f19258c800/0x27a633fcdd4bbe2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4bbdb expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940598.701367:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f19258c800/0x27a633fcdd4bbe2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4bbdb expref: 12 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940598.701378:0:14449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f19258c800/0x27a633fcdd4bbe2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4bbdb expref: 12 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940598.701389:0:14449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f19258c800, rc 0) 00000100:00100000:1.0:1788940598.701455:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1c181c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+12:14451:x1875839738283392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940598.701463:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788940598.701591:0:14451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ba977800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14451:1875839738283392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788940598.701609:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f188daa000/0x27a633fcdd4bbdb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4bbe2 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940598.701619:0:14451:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f188daa000/0x27a633fcdd4bbdb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4bbe2 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940598.701690:0:14451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4c27800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14451:1875839738283520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788940598.701722:0:14451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940598.701745:0:14451:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1862c0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788940598.701859:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738283520 00000100:00100000:1.0:1788940598.701864:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738283520 00000100:00100000:1.0:1788940598.701897:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788940598.701905:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1c181e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+12:14451:x1875839738283520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788940598.702232:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1c181e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+12:14451:x1875839738283520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 327us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940598.702240:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788940598.702356:0:14451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4c27800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14451:1875839738283520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788940598.702390:0:14451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4c27800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14451:1875839738283648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788940598.702444:0:14451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940598.702465:0:14451:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1862c0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788940598.703882:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738283648 00000100:00100000:2.0:1788940598.703898:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738283648 00000100:00100000:2.0:1788940598.703965:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788940598.703976:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1c181c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+12:14451:x1875839738283648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788940598.704261:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1c181c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+12:14451:x1875839738283648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 285us (1815us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940598.704269:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788940598.704426:0:14451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4c27800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14451:1875839738283648:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788940598.706625:0:14949:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788940598.706917:0:14451:0:(obd_config.c:2244:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788940598.706946:0:14451:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788940598.706962:0:14451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f188daa000/0x27a633fcdd4bbdb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4bbe2 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940598.706976:0:14451:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f188daa000/0x27a633fcdd4bbdb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4bbe2 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788940598.772340:0:14488:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788940598.957932:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940599.986300:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940601.011581:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940601.836912:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ba975880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3306:1875839738283776:0@lo:400:kworker.0 00000100:00100000:1.0:1788940601.837018:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788940601.837150:0:36:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788940601.837157:0:36:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788940601.837160:0:36:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788940601.837163:0:36:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788940601.837200:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ba974a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875839738283904:0@lo:400:kworker.0 00000100:00100000:0.0:1788940601.837241:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940601.837510:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738283776 00000100:00100000:2.0:1788940601.837553:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738283776 00000100:00100000:2.0:1788940601.837650:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788940601.837662:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1c181dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+12:3306:x1875839738283776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940601.838229:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738283904 00000100:00100000:3.0:1788940601.838237:0:14456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738283904 00000100:00100000:3.0:1788940601.838291:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788940601.838299:0:14456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f083eddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875839738283904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940601.838365:0:14456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f083eddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875839738283904:12345-0@lo:400:kworker.0 Request processed in 67us (1122us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940601.838374:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788940601.838456:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff89f1ba974a80 x1875839738283904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940617 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940601.838474:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ba974a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875839738283904:0@lo:400:kworker.0 00000100:00100000:2.0:1788940601.841669:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1c181dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+12:3306:x1875839738283776:12345-0@lo:400:kworker.0 Request processed in 3995us (4637us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940601.841689:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788940601.844198:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ba975880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3306:1875839738283776:0@lo:400:kworker.0 00010000:00010000:3.0:1788940602.031217:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940603.055410:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940604.085825:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788940604.136959:0:15137:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788940604.136964:0:15137:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1788940604.137076:0:15137:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff89f1af528800 00000020:01000004:2.0:1788940604.137096:0:15137:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788940604.137109:0:15137:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788940604.137123:0:15137:0:(genops.c:415:class_newdev()) Allocate new device lustre-OST0000-osd (ffff89f198018000) 00000020:00000080:2.0:1788940604.137154:0:15137:0:(obd_config.c:786:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788940604.188201:0:15137:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788940604.188738:0:15137:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788940604.190428:0:15137:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788940604.190767:0:15137:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1788940604.193914:0:15137:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788940604.195799:0:15137:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:2.0:1788940604.196120:0:15137:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:2.0:1788940604.196227:0:15137:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:2.0:1788940604.198448:0:15137:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 642: rc = 0 00100000:10000000:2.0:1788940604.199490:0:15137:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 642: rc = 0 00100000:10000000:3.0:1788940604.215408:0:15137:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 642: rc = 0 00100000:10000000:3.0:1788940604.217641:0:15137:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 642: rc = 0 00100000:10000000:3.0:1788940604.217963:0:15137:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 642: rc = 0 00100000:10000000:3.0:1788940604.218223:0:15137:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 642: rc = 0 00000020:00000080:3.0:1788940604.218844:0:15137:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788940604.218856:0:15137:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788940604.218868:0:15137:0:(genops.c:1393:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x27a633fcdd4bbf0 00000020:01000004:3.0:1788940604.218877:0:15137:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1788940604.218898:0:15137:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.114@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788940604.218901:0:15137:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.114@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788940604.218906:0:15137:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788940604.218911:0:15137:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788940604.218932:0:15137:0:(genops.c:415:class_newdev()) Allocate new device OSS (ffff89f1b6a219d8) 00000020:00000080:3.0:1788940604.218943:0:15137:0:(obd_config.c:786:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1788940604.232742:0:15137:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788940604.232999:0:15137:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788940604.233007:0:15137:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788940604.240371:0:15137:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788940604.242104:0:15137:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788940604.245043:0:15137:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788940604.245064:0:15137:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788940604.249819:0:15137:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788940604.250028:0:15137:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788940604.250036:0:15137:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788940604.263128:0:15137:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788940604.263152:0:15137:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788940604.318941:0:15137:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788940604.319267:0:15137:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788940604.319286:0:15137:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788940604.337855:0:15137:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788940604.337877:0:15137:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788940604.341114:0:15137:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788940604.341142:0:15137:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788940604.376619:0:15137:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788940604.376875:0:15137:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788940604.376884:0:15137:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788940604.380123:0:15137:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788940604.380137:0:15137:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1788940604.480651:0:15137:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788940604.480861:0:15137:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1788940604.480868:0:15137:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788940604.488214:0:15137:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788940604.488228:0:15137:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788940604.491990:0:15137:0:(obd_config.c:900:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788940604.492027:0:15137:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1788940604.492035:0:15137:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.114@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1788940604.514370:0:15137:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.114@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788940604.514691:0:15137:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.114@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1788940604.514697:0:15137:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788940604.514706:0:15137:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788940604.514707:0:15137:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788940604.514708:0:15137:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788940604.514709:0:15137:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788940604.514710:0:15137:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788940604.514712:0:15137:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788940604.514714:0:15137:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788940604.514715:0:15137:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788940604.514719:0:15137:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1788940604.514721:0:15137:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788940604.514722:0:15137:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788940604.514723:0:15137:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788940604.514724:0:15137:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788940604.514725:0:15137:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788940604.514726:0:15137:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788940604.514727:0:15137:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788940604.514727:0:15137:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788940604.514728:0:15137:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788940604.514757:0:15137:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788940604.514780:0:15137:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1baad4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15137:1875839738284032:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788940604.514936:0:15137:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940604.515035:0:15137:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1a97560c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788940604.515166:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738284032 00000100:00100000:0.0:1788940604.515174:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738284032 00000100:00100000:0.0:1788940604.515292:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788940604.515302:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1c181e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+12:15137:x1875839738284032:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788940604.515336:0:14448:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788940604.515340:0:14448:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1788940604.515345:0:14448:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788940604.523894:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1c181e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+12:15137:x1875839738284032:12345-0@lo:253:mount.lustre.0 Request processed in 8583us (8948us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940604.523909:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788940604.524154:0:15137:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1baad4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15137:1875839738284032:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788940604.524170:0:15137:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788940604.524173:0:15137:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788940604.524175:0:15137:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788940604.524176:0:15137:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788940604.524177:0:15137:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788940604.524178:0:15137:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788940604.524180:0:15137:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788940604.524181:0:15137:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788940604.524183:0:15137:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788940604.524184:0:15137:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788940604.524204:0:15137:0:(tgt_mount.c:101:server_register_mount()) register mount ffff89f1af528800 from lustre-OST0000 10000000:01000000:1.0:1788940604.524233:0:15137:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788940604.524235:0:15137:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788940604.524241:0:15137:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff89f1b5c78000 local copy 00010000:00010000:1.0:1788940604.524264:0:15137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f082ad2000/0x27a633fcdd4bae6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4baed expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940604.524505:0:15137:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1baad4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15137:1875839738284160:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788940604.524580:0:15137:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940604.524668:0:15137:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1b0c92cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940604.525210:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738284160 00000100:00100000:2.0:1788940604.525218:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738284160 00000100:00100000:2.0:1788940604.525303:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788940604.525313:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1c181e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+12:15137:x1875839738284160:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788940604.525540:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1c181e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+12:15137:x1875839738284160:12345-0@lo:501:mount.lustre.0 Request processed in 205us (937us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788940604.525558:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788940604.525635:0:15137:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1baad4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15137:1875839738284160:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788940604.525651:0:15137:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.114@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788940604.525805:0:15137:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.114@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788940604.525813:0:15137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f082ad2000/0x27a633fcdd4bae6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4baed expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940604.525823:0:15137:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f082ad2000/0x27a633fcdd4bae6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4baed expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940604.525861:0:15137:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff89f1af528800 10000000:01000000:1.0:1788940604.525866:0:15137:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788940604.525871:0:15137:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff89f1b5c78000 10000000:01000000:1.0:1788940604.525874:0:15137:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788940604.525877:0:15137:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff89f1b5c78000 from 1 10000000:01000000:1.0:1788940604.525880:0:15137:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788940604.525908:0:15137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f19258ce00/0x27a633fcdd4bbfe lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940604.525916:0:15137:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f19258ce00/0x27a633fcdd4bbfe lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940604.525924:0:15137:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f19258ce00/0x27a633fcdd4bbfe lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940604.525950:0:15137:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1baad4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15137:1875839738284288:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788940604.525979:0:15137:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940604.526294:0:15137:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1b0c92cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788940604.526405:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738284288 00000100:00100000:3.0:1788940604.526413:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738284288 00000100:00100000:3.0:1788940604.526447:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788940604.526455:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1c181fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+12:15137:x1875839738284288:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788940604.526465:0:14449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940604.526478:0:14449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f1bfa97200/0x27a633fcdd4bc05 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4bbfe expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940604.526500:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f1bfa97200/0x27a633fcdd4bc05 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4bbfe expref: 13 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940604.526511:0:14449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f1bfa97200/0x27a633fcdd4bc05 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4bbfe expref: 13 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940604.526535:0:14449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f1bfa97200, rc 0) 00000100:00100000:3.0:1788940604.526578:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1c181fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+13:15137:x1875839738284288:12345-0@lo:101:mount.lustre.0 Request processed in 124us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940604.526585:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788940604.526669:0:15137:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1baad4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15137:1875839738284288:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788940604.526684:0:15137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f19258ce00/0x27a633fcdd4bbfe lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4bc05 expref: -99 pid: 15137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940604.526692:0:15137:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f19258ce00/0x27a633fcdd4bbfe lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4bc05 expref: -99 pid: 15137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940604.526935:0:15137:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788940604.527022:0:15137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f19258ce00/0x27a633fcdd4bbfe lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4bc05 expref: -99 pid: 15137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940604.527031:0:15137:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f19258ce00/0x27a633fcdd4bbfe lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4bc05 expref: -99 pid: 15137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940604.527038:0:15137:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788940604.527042:0:15137:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788940604.527057:0:15137:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788940604.527060:0:15137:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788940604.527080:0:15137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f19258de00/0x27a633fcdd4bc0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940604.527088:0:15137:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f19258de00/0x27a633fcdd4bc0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940604.527096:0:15137:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f19258de00/0x27a633fcdd4bc0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940604.527125:0:15137:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1baad4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15137:1875839738284416:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788940604.527154:0:15137:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940604.527176:0:15137:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1b0c92cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940604.527300:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738284416 00000100:00100000:2.0:1788940604.527305:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738284416 00000100:00100000:2.0:1788940604.527332:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788940604.527339:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1c181d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+13:15137:x1875839738284416:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788940604.527347:0:14446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940604.527356:0:14446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f188dab400/0x27a633fcdd4bc13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4bc0c expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940604.527372:0:14446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f188dab400/0x27a633fcdd4bc13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4bc0c expref: 14 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940604.527391:0:14446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f188dab400/0x27a633fcdd4bc13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4bc0c expref: 14 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940604.527398:0:14446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f188dab400, rc 0) 00000100:00100000:2.0:1788940604.527438:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1c181d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+14:15137:x1875839738284416:12345-0@lo:101:mount.lustre.0 Request processed in 99us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940604.527444:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788940604.527544:0:15137:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1baad4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15137:1875839738284416:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788940604.527556:0:15137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f19258de00/0x27a633fcdd4bc0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4bc13 expref: -99 pid: 15137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940604.527564:0:15137:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f19258de00/0x27a633fcdd4bc0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4bc13 expref: -99 pid: 15137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788940604.528408:0:15137:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788940604.529312:0:15137:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788940604.529616:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788940604.529661:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788940604.529696:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788940604.529745:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788940604.529783:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788940604.529816:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1788940604.529898:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1788940604.529906:0:15137:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788940604.529996:0:15137:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1baad4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15137:1875839738284544:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788940604.530064:0:15137:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940604.530105:0:15137:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1b0c92f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788940604.531863:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738284544 00000100:00100000:2.0:1788940604.531878:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738284544 00000100:00100000:2.0:1788940604.531928:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788940604.531937:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1c181cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+14:15137:x1875839738284544:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788940604.532394:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1c181cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+14:15137:x1875839738284544:12345-0@lo:501:mount.lustre.0 Request processed in 457us (2329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940604.532403:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788940604.538023:0:15137:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1baad4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15137:1875839738284544:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788940604.540257:0:15137:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1baad4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15137:1875839738284672:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788940604.540353:0:15137:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940604.540437:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738284672 00000100:00100000:0.0:1788940604.540445:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738284672 00000100:00100000:0.0:1788940604.540531:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788940604.540544:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1c181d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+14:15137:x1875839738284672:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788940604.545591:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1c181d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+14:15137:x1875839738284672:12345-0@lo:503:mount.lustre.0 Request processed in 5036us (5224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940604.545608:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788940604.546731:0:15137:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1b0c92f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788940604.546769:0:15137:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1baad4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15137:1875839738284672:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788940604.548024:0:15137:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788940604.548186:0:15137:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1baad4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15137:1875839738284800:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788940604.548265:0:15137:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940604.548445:0:15137:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1b0c92f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788940604.549160:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738284800 00000100:00100000:3.0:1788940604.549171:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738284800 00000100:00100000:3.0:1788940604.549235:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788940604.549257:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1c181f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+14:15137:x1875839738284800:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788940604.554118:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1c181f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+14:15137:x1875839738284800:12345-0@lo:502:mount.lustre.0 Request processed in 4855us (5843us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940604.554135:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788940604.557117:0:15137:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1baad4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15137:1875839738284800:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788940604.559231:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1788940604.559313:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1788940604.559352:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1788940604.559430:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1788940604.559474:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1788940604.559554:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1788940604.559609:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1788940604.559645:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1788940604.559678:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1788940604.560178:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1788940604.560225:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1788940604.560273:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1788940604.560329:0:15137:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ba977480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15137:1875839738284928:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788940604.560434:0:15137:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940604.560491:0:15137:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1aeec6240 going to sleep for 11 seconds 00000100:00100000:0.0:1788940604.560632:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738284928 00000100:00100000:0.0:1788940604.560642:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738284928 00000100:00100000:0.0:1788940604.560712:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788940604.560722:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1c181f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+14:15137:x1875839738284928:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788940604.561177:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1c181f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+14:15137:x1875839738284928:12345-0@lo:502:mount.lustre.0 Request processed in 456us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940604.561185:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788940604.561290:0:15137:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ba977480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15137:1875839738284928:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788940604.561373:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1788940604.561396:0:15137:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:0.0:1788940604.563055:0:15151:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788940604.563067:0:15151:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1788940604.563084:0:15151:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940604.563086:0:15151:0:(obd_config.c:1662:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788940604.563092:0:15151:0:(obd_config.c:1571:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788940604.563309:0:15151:0:(genops.c:415:class_newdev()) Allocate new device lustre-OST0000 (ffff89f1982e33b0) 00000020:00000080:0.0:1788940604.563335:0:15151:0:(obd_config.c:786:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788940604.563342:0:15151:0:(obd_config.c:1571:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788940604.563418:0:15151:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89f1af528800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788940604.563427:0:15151:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788940604.563434:0:15151:0:(genops.c:1393:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x27a633fcdd4bc21 00010000:00010000:2.0:1788940604.576596:0:15151:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1788940604.577299:0:15151:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:2.0:1788940604.580583:0:15151:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1788940604.585640:0:15151:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788940604.585654:0:15151:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788940604.585661:0:15151:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940604.585663:0:15151:0:(obd_config.c:1662:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788940604.585666:0:15151:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788940604.585669:0:15151:0:(obd_config.c:2001:class_config_llog_handler()) SKIP #16 00000020:01000000:2.0:1788940604.585670:0:15151:0:(obd_config.c:2027:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788940604.585672:0:15151:0:(obd_config.c:2027:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788940604.585673:0:15151:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788940604.585676:0:15151:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940604.585677:0:15151:0:(obd_config.c:1662:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788940604.585982:0:15151:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788940604.585990:0:15151:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940604.585991:0:15151:0:(obd_config.c:1662:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788940604.585995:0:15151:0:(obd_config.c:1571:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788940604.585997:0:15151:0:(obd_config.c:1636:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788940604.585999:0:15151:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788940604.586002:0:15151:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940604.586003:0:15151:0:(obd_config.c:1662:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788940604.586005:0:15151:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788940604.586007:0:15151:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940604.586008:0:15151:0:(obd_config.c:1662:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788940604.586012:0:15151:0:(obd_config.c:1571:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788940604.586082:0:15151:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788940604.586087:0:15151:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940604.586088:0:15151:0:(obd_config.c:1662:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788940604.586091:0:15151:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1788940604.586265:0:15137:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1788940604.586616:0:15137:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788940604.586639:0:15137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f19258de00/0x27a633fcdd4bc0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4bc13 expref: -99 pid: 15137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940604.586652:0:15137:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f19258de00/0x27a633fcdd4bc0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4bc13 expref: -99 pid: 15137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940604.586813:0:15137:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89f1af528800 from 1 10000000:01000000:2.0:1788940604.586816:0:15137:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788940604.586853:0:15137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f188daba00/0x27a633fcdd4bc28 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940604.586863:0:15137:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f188daba00/0x27a633fcdd4bc28 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940604.586873:0:15137:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f188daba00/0x27a633fcdd4bc28 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940604.586897:0:15137:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ba977480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15137:1875839738285056:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788940604.587037:0:15137:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940604.587607:0:15137:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1aeec66c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788940604.591682:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738285056 00000100:00100000:3.0:1788940604.592156:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738285056 00000100:00100000:3.0:1788940604.592225:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788940604.592235:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1af527450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+14:15137:x1875839738285056:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788940604.592252:0:14449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940604.592271:0:14449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f1bfa96200/0x27a633fcdd4bc2f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4bc28 expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940604.592299:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f1bfa96200/0x27a633fcdd4bc2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4bc28 expref: 15 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940604.592310:0:14449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f1bfa96200/0x27a633fcdd4bc2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4bc28 expref: 15 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940604.592319:0:14449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f1bfa96200, rc 0) 00000100:00100000:3.0:1788940604.592410:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1af527450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+15:15137:x1875839738285056:12345-0@lo:101:mount.lustre.0 Request processed in 176us (5372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940604.592417:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788940604.592461:0:15137:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ba977480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15137:1875839738285056:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788940604.592481:0:15137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f188daba00/0x27a633fcdd4bc28 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4bc2f expref: -99 pid: 15137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940604.592491:0:15137:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f188daba00/0x27a633fcdd4bc28 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4bc2f expref: -99 pid: 15137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788940604.593007:0:15137:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1788940604.596108:0:15137:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788940604.598191:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1788940604.598274:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1788940604.598368:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1788940604.598386:0:15137:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1788940604.598534:0:15137:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1baad4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15137:1875839738285184:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788940604.598610:0:15137:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940604.598649:0:15137:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1b0c92600 going to sleep for 11 seconds 00000100:00100000:0.0:1788940604.599070:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738285184 00000100:00100000:0.0:1788940604.599079:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738285184 00000100:00100000:0.0:1788940604.599129:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788940604.599140:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1af526850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+15:15137:x1875839738285184:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788940604.599370:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1af526850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+15:15137:x1875839738285184:12345-0@lo:501:mount.lustre.0 Request processed in 231us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940604.599391:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788940604.599497:0:15137:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1baad4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15137:1875839738285184:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788940604.599553:0:15137:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1baad4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15137:1875839738285312:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788940604.599591:0:15137:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940604.599610:0:15137:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1b0c92600 going to sleep for 11 seconds 00000100:00100000:1.0:1788940604.599625:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738285312 00000100:00100000:1.0:1788940604.599629:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738285312 00000100:00100000:1.0:1788940604.599650:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788940604.599657:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1af526c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+15:15137:x1875839738285312:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788940604.599785:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1af526c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+15:15137:x1875839738285312:12345-0@lo:503:mount.lustre.0 Request processed in 128us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940604.599791:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788940604.599825:0:15137:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1baad4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15137:1875839738285312:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788940604.600729:0:15137:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788940604.600793:0:15137:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1baad4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15137:1875839738285440:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788940604.600838:0:15137:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940604.600923:0:15137:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1b0c92600 going to sleep for 11 seconds 00000100:00100000:0.0:1788940604.602489:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738285440 00000100:00100000:0.0:1788940604.602503:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738285440 00000100:00100000:0.0:1788940604.602777:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788940604.602789:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1af527050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+15:15137:x1875839738285440:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788940604.603312:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1af527050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+15:15137:x1875839738285440:12345-0@lo:502:mount.lustre.0 Request processed in 524us (2471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940604.603321:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788940604.603715:0:15137:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1baad4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15137:1875839738285440:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788940604.604005:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788940604.604043:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1788940604.604087:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1788940604.604123:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1788940604.604143:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1788940604.604180:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1788940604.604199:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1788940604.604215:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1788940604.604248:0:15137:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1baad4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15137:1875839738285568:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788940604.604289:0:15137:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940604.604325:0:15137:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1b0c92600 going to sleep for 11 seconds 00000100:00100000:0.0:1788940604.604341:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738285568 00000100:00100000:0.0:1788940604.604347:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738285568 00000100:00100000:0.0:1788940604.604407:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788940604.604416:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1af527850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+15:15137:x1875839738285568:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788940604.604720:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1af527850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+15:15137:x1875839738285568:12345-0@lo:502:mount.lustre.0 Request processed in 304us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940604.604737:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788940604.604762:0:15137:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1baad4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15137:1875839738285568:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788940604.604844:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1788940604.604854:0:15137:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1788940604.611409:0:15155:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788940604.611442:0:15155:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940604.611445:0:15155:0:(obd_config.c:1662:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788940604.611453:0:15155:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: general-ffff89f1af528800 00000020:00000080:1.0:1788940604.611455:0:15155:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788940604.611464:0:15155:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788940604.611466:0:15155:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940604.611468:0:15155:0:(obd_config.c:1662:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788940604.611470:0:15155:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788940604.611473:0:15155:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940604.611474:0:15155:0:(obd_config.c:1662:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788940604.611612:0:15155:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: general-ffff89f1af528800 00000020:00000080:1.0:1788940604.611616:0:15155:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788940604.611789:0:15155:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788940604.611793:0:15155:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940604.611795:0:15155:0:(obd_config.c:1662:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788940604.611797:0:15155:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788940604.611800:0:15155:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940604.611801:0:15155:0:(obd_config.c:1662:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788940604.611805:0:15155:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff89f1af528800 00000020:00000080:1.0:1788940604.611807:0:15155:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788940604.620934:0:15155:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788940604.620947:0:15155:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940604.620954:0:15155:0:(obd_config.c:1662:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788940604.620959:0:15155:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1788940604.624669:0:15137:0:(obd_config.c:2244:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788940604.624904:0:15137:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788940604.624930:0:15137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f188daba00/0x27a633fcdd4bc28 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4bc2f expref: -99 pid: 15137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940604.624954:0:15137:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f188daba00/0x27a633fcdd4bc28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4bc2f expref: -99 pid: 15137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940604.625036:0:15137:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788940604.625040:0:15137:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff89f1af528800 10000000:01000000:2.0:1788940604.625043:0:15137:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff89f1af528800 10000000:01000000:2.0:1788940604.625048:0:15137:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788940604.625054:0:15137:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff89f1af528800 from 1 10000000:01000000:2.0:1788940604.625056:0:15137:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788940604.625100:0:15137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f188dab800/0x27a633fcdd4bc36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940604.625108:0:15137:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f188dab800/0x27a633fcdd4bc36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940604.625119:0:15137:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f188dab800/0x27a633fcdd4bc36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940604.625144:0:15137:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ba975500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15137:1875839738285696:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788940604.625212:0:15137:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940604.625251:0:15137:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1aeec6a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788940604.625624:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738285696 00000100:00100000:0.0:1788940604.625634:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738285696 00000100:00100000:0.0:1788940604.625686:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788940604.625696:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1af526050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+15:15137:x1875839738285696:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788940604.625717:0:14449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940604.625732:0:14449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f082ad2800/0x27a633fcdd4bc3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4bc36 expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940604.625758:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f082ad2800/0x27a633fcdd4bc3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4bc36 expref: 16 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940604.625768:0:14449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f082ad2800/0x27a633fcdd4bc3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4bc36 expref: 16 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940604.625777:0:14449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f082ad2800, rc 0) 00000100:00100000:0.0:1788940604.625823:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1af526050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+16:15137:x1875839738285696:12345-0@lo:101:mount.lustre.0 Request processed in 129us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940604.625830:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788940604.626659:0:15137:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ba975500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15137:1875839738285696:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788940604.626681:0:15137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f188dab800/0x27a633fcdd4bc36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4bc3d expref: -99 pid: 15137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940604.626939:0:15137:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f188dab800/0x27a633fcdd4bc36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4bc3d expref: -99 pid: 15137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788940604.627807:0:15137:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1788940604.630290:0:15137:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788940604.630876:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788940604.630927:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1788940604.630966:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1788940604.631014:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1788940604.631067:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1788940604.631116:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1788940604.631153:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1788940604.631186:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1788940604.631239:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1788940604.631277:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1788940604.631314:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1788940604.631368:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788940604.631422:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788940604.631459:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788940604.631553:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788940604.631594:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788940604.631632:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788940604.631683:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788940604.631722:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1788940604.631759:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1788940604.631830:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1788940604.631871:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1788940604.631908:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1788940604.631962:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1788940604.632000:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1788940604.632033:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1788940604.632096:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1788940604.632132:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1788940604.632206:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1788940604.632222:0:15137:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1788940604.632322:0:15137:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ba975500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15137:1875839738285824:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788940604.632405:0:15137:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940604.632454:0:15137:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1aeec6a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788940604.633193:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738285824 00000100:00100000:2.0:1788940604.633204:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738285824 00000100:00100000:2.0:1788940604.633262:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788940604.633271:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1af525050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+16:15137:x1875839738285824:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788940604.633981:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1af525050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+16:15137:x1875839738285824:12345-0@lo:501:mount.lustre.0 Request processed in 709us (1574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940604.633991:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788940604.634082:0:15137:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ba975500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15137:1875839738285824:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788940604.634129:0:15137:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4c27800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15137:1875839738285952:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788940604.634174:0:15137:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940604.634212:0:15137:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f188da6cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940604.634260:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738285952 00000100:00100000:2.0:1788940604.634266:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738285952 00000100:00100000:2.0:1788940604.634300:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788940604.634308:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1af524c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+16:15137:x1875839738285952:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788940604.634492:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1af524c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+16:15137:x1875839738285952:12345-0@lo:503:mount.lustre.0 Request processed in 173us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940604.634499:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788940604.634618:0:15137:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4c27800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15137:1875839738285952:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788940604.635420:0:15137:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788940604.635503:0:15137:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4c27800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15137:1875839738286080:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788940604.635592:0:15137:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940604.635627:0:15137:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f188da6cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940604.636181:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738286080 00000100:00100000:2.0:1788940604.636188:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738286080 00000100:00100000:2.0:1788940604.636244:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788940604.636252:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1af524050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+16:15137:x1875839738286080:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788940604.636561:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1af524050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+16:15137:x1875839738286080:12345-0@lo:502:mount.lustre.0 Request processed in 308us (973us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940604.636568:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788940604.636674:0:15137:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4c27800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15137:1875839738286080:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788940604.637110:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788940604.637162:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1788940604.637195:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1788940604.637241:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1788940604.637279:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1788940604.637327:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1788940604.637364:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1788940604.637429:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1788940604.640772:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788940604.641635:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1788940604.641686:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1788940604.642966:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1788940604.643012:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1788940604.643041:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1788940604.643077:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1788940604.643107:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1788940604.643133:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1788940604.643169:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1788940604.643198:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1788940604.643223:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1788940604.643264:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1788940604.643300:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1788940604.643334:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1788940604.643397:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1788940604.643455:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1788940604.643498:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1788940604.643572:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1788940604.643610:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1788940604.643645:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1788940604.643695:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1788940604.645367:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1788940604.645425:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1788940604.645458:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1788940604.645538:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1788940604.645577:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1788940604.645624:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1788940604.645657:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1788940604.645705:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1788940604.645767:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1788940604.645800:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1788940604.648165:0:15137:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4c27800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15137:1875839738286208:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788940604.648257:0:15137:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940604.648312:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738286208 00000100:00100000:3.0:1788940604.648319:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738286208 00000100:00100000:2.0:1788940604.648827:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788940604.648925:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1af525450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+16:15137:x1875839738286208:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788940604.649186:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1af525450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+16:15137:x1875839738286208:12345-0@lo:502:mount.lustre.0 Request processed in 266us (927us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940604.649194:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788940604.649958:0:15137:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f188da6cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788940604.649989:0:15137:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4c27800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15137:1875839738286208:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788940604.650124:0:15137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1788940604.650140:0:15137:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1788940604.663988:0:15160:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788940604.664007:0:15160:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff89f1b51833b0) 00000020:00000080:1.0:1788940604.664035:0:15160:0:(obd_config.c:786:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1788940604.664133:0:15160:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89f1af528800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788940604.664138:0:15160:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89f1af528800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788940604.664142:0:15160:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89f1af528800 3 00010000:00080000:1.0:1788940604.664175:0:15160:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89f1bee9d800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.114@tcp at head 00010000:00010000:2.0:1788940604.670498:0:15160:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1788940604.670728:0:15160:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788940604.670767:0:15160:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788940604.670781:0:15160:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x27a633fcdd4bc4b 00000100:00080000:2.0:1788940604.670792:0:15160:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788940604.670798:0:15160:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89f1bee9d800 using connection 192.168.202.114@tcp/0@lo 00000100:00100000:2.0:1788940604.670836:0:15160:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89f1ba974700 x1875839738286336/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788940604.670885:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ba974700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1875839738286336:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788940604.670955:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940604.671021:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738286336 00000100:00100000:2.0:1788940604.671029:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738286336 00000100:00100000:2.0:1788940604.671057:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788940604.671063:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ba976a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1875839738286336:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788940604.671098:0:14454:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 547 last 0 00000020:00000080:2.0:1788940604.671128:0:14454:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x27a633fcdd4bc52 00000004:00100000:2.0:1788940604.671143:0:14454:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788940604.671174:0:14454:0:(import.c:65:import_set_state_nolock()) ffff89f1bee0d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788940604.671220:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ba976a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875839738286336:12345-0@lo:38:llog_process_th.0 Request processed in 156us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940604.671227:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788940604.671263:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff89f1ba974700 x1875839738286336/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788940614 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940604.671286:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788940604.671293:0:3304:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1788940604.671301:0:3304:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788940604.671305:0:3304:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788940604.671307:0:3304:0:(import.c:65:import_set_state_nolock()) ffff89f1bee9d800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788940604.671313:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ba974700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1875839738286336:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1788940604.671332:0:15160:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788940604.671354:0:38:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788940604.671359:0:38:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788940604.671362:0:38:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788940604.671365:0:38:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788940604.671412:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ba974700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875839738286464:0@lo:400:kworker.0 00000100:00100000:2.0:1788940604.671435:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940604.671467:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738286464 00000100:00100000:2.0:1788940604.671470:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738286464 00000100:00100000:2.0:1788940604.671493:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788940604.671498:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ba977b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875839738286464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940604.671553:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ba977b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875839738286464:12345-0@lo:400:kworker.0 Request processed in 54us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940604.671559:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788940604.671580:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff89f1ba974700 x1875839738286464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940620 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940604.671589:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ba974700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875839738286464:0@lo:400:kworker.0 00000040:00080000:1.0:1788940604.677246:0:15160:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1788940604.677463:0:15137:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788940604.677493:0:15137:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788940604.677539:0:15137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f188dab800/0x27a633fcdd4bc36 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4bc3d expref: -99 pid: 15137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940604.677553:0:15137:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f188dab800/0x27a633fcdd4bc36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4bc3d expref: -99 pid: 15137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788940604.677605:0:15137:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788940604.677612:0:15137:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788940604.677613:0:15137:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788940604.677614:0:15137:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788940604.677615:0:15137:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788940604.677617:0:15137:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788940604.677618:0:15137:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788940604.677620:0:15137:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788940604.677621:0:15137:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788940604.677625:0:15137:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1788940604.677627:0:15137:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788940604.677628:0:15137:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788940604.677629:0:15137:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788940604.677630:0:15137:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788940604.677631:0:15137:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788940604.677632:0:15137:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788940604.677633:0:15137:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788940604.677634:0:15137:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788940604.677635:0:15137:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788940604.677661:0:15137:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788940604.677681:0:15137:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f083edca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15137:1875839738286592:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788940604.677872:0:15137:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940604.677917:0:15137:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f186522840 going to sleep for 11 seconds 00000100:00100000:3.0:1788940604.677968:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738286592 00000100:00100000:3.0:1788940604.677976:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738286592 00000100:00100000:3.0:1788940604.678030:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788940604.678041:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1af527c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+16:15137:x1875839738286592:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788940604.678065:0:14446:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788940604.678080:0:14446:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788940604.711395:0:14446:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788940604.711423:0:14446:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788940604.711456:0:14470:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788940604.711462:0:14470:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788940604.711493:0:14470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89f1bfa96800/0x27a633fcdd4bc59 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940604.711511:0:14470:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89f188daa600/0x27a633fcdd4bbc6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4bbbf expref: 16 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940604.711542:0:14470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89f1bfa96800/0x27a633fcdd4bc59 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940604.711582:0:14470:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89f188daa600/0x27a633fcdd4bbc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27a633fcdd4bbbf expref: 16 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940604.711596:0:14470:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89f188daa600/0x27a633fcdd4bbc6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27a633fcdd4bbbf expref: 16 pid: 14446 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940604.711610:0:14470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4c27800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14470:1875839738286720:0@lo:104: 00000100:00100000:3.0:1788940604.711675:0:14470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940604.711727:0:14470:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1baa6bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788940604.713456:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738286720 00000100:00100000:1.0:1788940604.713471:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738286720 00000100:00100000:1.0:1788940604.713558:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788940604.713569:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4c25500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+3:14470:x1875839738286720:12345-0@lo:104: 00010000:00010000:1.0:1788940604.713586:0:14438:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97c00/0x27a633fcdd4bbbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4bbc6 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940604.713670:0:14438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788940604.713676:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4c25500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+3:14470:x1875839738286720:12345-0@lo:104: Request processed in 110us (2002us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940604.713683:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788940604.714047:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940604.714055:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97c00/0x27a633fcdd4bbbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4bbc6 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940604.714064:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1bfa97c00 already unused, calling callback (ffffffffc1d10c20) 10000000:00010000:3.0:1788940604.714068:0:14443:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97c00/0x27a633fcdd4bbbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x27a633fcdd4bbc6 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940604.714078:0:14443:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97c00/0x27a633fcdd4bbbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x27a633fcdd4bbc6 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788940604.714107:0:14443:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97c00/0x27a633fcdd4bbbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x27a633fcdd4bbc6 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940604.714113:0:14443:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788940604.714150:0:14443:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97c00/0x27a633fcdd4bbbf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4bbc6 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940604.714158:0:14443:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788940604.714181:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97c00/0x27a633fcdd4bbbf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4bbc6 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940604.714188:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97c00/0x27a633fcdd4bbbf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4bbc6 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940604.714210:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940604.714213:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940604.714214:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940604.714245:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4c27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3305:1875839738286848:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788940604.714289:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940604.714358:0:14440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738286848 00000100:00100000:3.0:1788940604.714362:0:14440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738286848 00010000:00010000:3.0:1788940604.714396:0:14440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89f188daa600/0x27a633fcdd4bbc6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4bbbf expref: 17 pid: 14446 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940604.714421:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788940604.714428:0:14440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4c24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+17:3305:x1875839738286848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788940604.714440:0:14440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940604.714446:0:14440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89f188daa600/0x27a633fcdd4bbc6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4bbbf expref: 17 pid: 14446 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940604.714464:0:14440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89f188daa600/0x27a633fcdd4bbc6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27a633fcdd4bbbf expref: 17 pid: 14446 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940604.714481:0:14440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89f1bfa96800/0x27a633fcdd4bc59 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940604.714490:0:14440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f1bfa96800/0x27a633fcdd4bc59 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788940604.714503:0:14440:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003605066s 00010000:00010000:3.0:1788940604.714508:0:14440:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89f1bfa96800/0x27a633fcdd4bc59 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940604.714531:0:14440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89f1bfa96800/0x27a633fcdd4bc59 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940604.714539:0:14440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89f1bfa96800/0x27a633fcdd4bc59 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940604.714545:0:14440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89f1bfa96800/0x27a633fcdd4bc59 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940604.714551:0:14440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1bfa96800 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:3.0:1788940604.714555:0:14440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89f1bfa96800/0x27a633fcdd4bc59 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940604.714562:0:14440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89f1bfa96800/0x27a633fcdd4bc59 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940604.714571:0:14440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89f1bfa96800/0x27a633fcdd4bc59 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940604.714593:0:14440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940604.714624:0:14440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4c24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+17:3305:x1875839738286848:12345-0@lo:103:ldlm_bl.0 Request processed in 196us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940604.714631:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788940604.714669:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4c27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3305:1875839738286848:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788940604.716026:0:14470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f188daa600/0x27a633fcdd4bbc6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27a633fcdd4bbbf expref: 16 pid: 14446 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940604.716042:0:14470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4c27800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14470:1875839738286720:0@lo:104: 00010000:00010000:3.0:1788940604.716062:0:14470:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89f1bfa96800/0x27a633fcdd4bc59 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940604.716071:0:14470:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89f1bfa96800/0x27a633fcdd4bc59 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940604.716077:0:14470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89f1bfa96800/0x27a633fcdd4bc59 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940604.716082:0:14470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f1bfa96800/0x27a633fcdd4bc59 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940604.730850:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1af527c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+15:15137:x1875839738286592:12345-0@lo:253:mount.lustre.0 Request processed in 52802us (52969us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940604.730867:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788940604.731003:0:15137:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f083edca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15137:1875839738286592:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788940604.731019:0:15137:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788940604.731022:0:15137:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788940604.731024:0:15137:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788940604.731025:0:15137:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788940604.731027:0:15137:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788940604.731028:0:15137:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788940604.731029:0:15137:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788940604.731030:0:15137:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788940604.731032:0:15137:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788940604.731033:0:15137:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788940604.731047:0:15137:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788940604.741999:0:15137:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788940604.742203:0:15137:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788940604.742368:0:15137:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788940604.742585:0:15137:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788940604.743354:0:15137:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788940604.744329:0:15137:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788940604.746187:0:15137:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788940604.815051:0:15137:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788940604.815060:0:15137:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788940604.815098:0:15137:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788940604.815154:0:15137:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.114@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788940604.815169:0:15137:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788940604.815197:0:15137:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1788940605.101905:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940606.127550:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788940606.530221:0:14451:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788940606.530230:0:14451:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff89f1b0c14800 from 7 10000000:01000000:2.0:1788940606.530236:0:14451:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788940606.530280:0:14451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f188daac00/0x27a633fcdd4bc60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940606.530292:0:14451:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f188daac00/0x27a633fcdd4bc60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940606.530303:0:14451:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f188daac00/0x27a633fcdd4bc60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940606.530329:0:14451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ba974700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14451:1875839738286976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788940606.530406:0:14451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940606.530447:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738286976 00000100:00100000:2.0:1788940606.530453:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738286976 00000100:00100000:2.0:1788940606.530513:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788940606.530538:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1af524450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+15:14451:x1875839738286976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788940606.530552:0:14448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940606.530565:0:14448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f188daa400/0x27a633fcdd4bc67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4bc60 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940606.530587:0:14448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f188daa400/0x27a633fcdd4bc67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4bc60 expref: 16 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940606.530609:0:14448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f188daa400/0x27a633fcdd4bc67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4bc60 expref: 16 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940606.530617:0:14448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f188daa400, rc 0) 00000100:00100000:2.0:1788940606.530651:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1af524450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+16:14451:x1875839738286976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940606.530657:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788940606.530716:0:14451:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1841b36c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940606.530737:0:14451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ba974700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14451:1875839738286976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788940606.530751:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f188daac00/0x27a633fcdd4bc60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4bc67 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940606.530759:0:14451:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f188daac00/0x27a633fcdd4bc60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4bc67 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940606.530807:0:14451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ba974700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14451:1875839738287104:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788940606.530837:0:14451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940606.530859:0:14451:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1841b36c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788940606.533019:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738287104 00000100:00100000:1.0:1788940606.533036:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738287104 00000100:00100000:1.0:1788940606.533117:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788940606.533128:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1af525850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+16:14451:x1875839738287104:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788940606.533166:0:14446:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788940606.533182:0:14446:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788940606.533185:0:14446:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1788940606.533593:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1af525850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+16:14451:x1875839738287104:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 466us (2754us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940606.533602:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788940606.534431:0:14451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ba974700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14451:1875839738287104:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788940606.534509:0:14451:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788940606.534538:0:14451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f188daac00/0x27a633fcdd4bc60 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4bc67 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940606.534549:0:14451:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f188daac00/0x27a633fcdd4bc60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4bc67 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940607.161758:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940608.172737:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788940609.022939:0:14488:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788940609.196628:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788940610.032975:0:38:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788940610.032983:0:38:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788940610.032987:0:38:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788940610.032990:0:38:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788940610.033062:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ba974000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875839738287360:0@lo:400:kworker.0 00000100:00100000:2.0:1788940610.033135:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940610.033212:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788940610.033219:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ba975500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875839738287488:0@lo:400:kworker.0 00000100:00100000:2.0:1788940610.033245:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940610.033488:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738287360 00000100:00100000:2.0:1788940610.033497:0:14456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738287360 00000100:00100000:2.0:1788940610.033558:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738287488 00000100:00100000:2.0:1788940610.033562:0:14456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738287488 00000100:00100000:2.0:1788940610.033589:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788940610.033597:0:14456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ba977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875839738287360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940610.033651:0:14456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ba977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875839738287360:12345-0@lo:400:kworker.0 Request processed in 54us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940610.033659:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788940610.033676:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788940610.033683:0:14456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ba975880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875839738287488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940610.033712:0:14456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ba975880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875839738287488:12345-0@lo:400:kworker.0 Request processed in 30us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940610.033718:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788940610.033795:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89f1ba975500 x1875839738287488/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940626 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940610.033821:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ba975500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875839738287488:0@lo:400:kworker.0 00010000:00080000:2.0:1788940610.033835:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89f1ba974000 x1875839738287360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940626 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940610.033844:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ba974000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875839738287360:0@lo:400:kworker.0 00000100:00100000:2.0:1788940610.033883:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ba974700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3306:1875839738287232:0@lo:400:kworker.0 00000100:00100000:2.0:1788940610.033917:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940610.033955:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738287232 00000100:00100000:2.0:1788940610.033958:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738287232 00000100:00100000:2.0:1788940610.033990:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788940610.033998:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1af524850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+16:3306:x1875839738287232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940610.034033:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1af524850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+16:3306:x1875839738287232:12345-0@lo:400:kworker.0 Request processed in 36us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940610.034039:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788940610.034069:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ba974700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3306:1875839738287232:0@lo:400:kworker.0 00000100:00080000:3.0:1788940610.039680:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788940610.224046:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940611.244628:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940611.824430:0:3304:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788940596/real 1788940596] req@ffff89f1baad5f80 x1875839738282880/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788940611 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940611.824467:0:3304:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff89f1baad5f80 x1875839738282880/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788940611 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940611.824478:0:3304:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788940596/real 1788940596] req@ffff89f1baad4700 x1875839738283008/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788940611 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940611.824489:0:3304:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff89f1baad4700 x1875839738283008/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788940611 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788940611.824509:0:3304:0:(import.c:65:import_set_state_nolock()) ffff89f194b4f800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788940611.824541:0:3304:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788940611.824546:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1baad5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875839738282880:0@lo:8:kworker.0 00000100:00080000:1.0:1788940611.824552:0:3304:0:(import.c:65:import_set_state_nolock()) ffff89f192361800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788940611.824557:0:3304:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788940611.824560:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1baad4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875839738283008:0@lo:8:kworker.0 00000100:00080000:1.0:1788940611.824640:0:38:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788940611.824645:0:38:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788940611.824647:0:38:0:(import.c:65:import_set_state_nolock()) ffff89f194b4f800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788940611.824666:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 539 00000100:00080000:1.0:1788940611.824672:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788940611.824679:0:38:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff89f194b4f800 using connection 192.168.202.114@tcp/0@lo 00000100:00100000:1.0:1788940611.824699:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89f1baad5f80 x1875839738287744/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788940611.824712:0:38:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788940611.824715:0:38:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788940611.824716:0:38:0:(import.c:65:import_set_state_nolock()) ffff89f192361800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788940611.824719:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 539 00000100:00080000:1.0:1788940611.824722:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788940611.824725:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff89f192361800 using connection 192.168.202.114@tcp/0@lo 00000100:00100000:1.0:1788940611.824733:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89f1baad4a80 x1875839738287872/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788940611.825298:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1baad4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3305:1875839738287616:0@lo:400:kworker.0 00000100:00100000:1.0:1788940611.825376:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940611.825439:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788940611.825445:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1baad5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875839738288000:0@lo:400:kworker.0 00000100:00100000:1.0:1788940611.825475:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940611.825509:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1baad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875839738288128:0@lo:400:kworker.0 00000100:00100000:3.0:1788940611.825693:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738288000 00000100:00100000:3.0:1788940611.825703:0:14456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738288000 00000100:00100000:3.0:1788940611.825754:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788940611.825776:0:14456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1baad6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875839738288000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940611.825832:0:14456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1baad6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875839738288000:12345-0@lo:400:kworker.0 Request processed in 69us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940611.825841:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788940611.825885:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89f1baad5c00 x1875839738288000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940627 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940611.825898:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1baad5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875839738288000:0@lo:400:kworker.0 00000100:00100000:1.0:1788940611.826169:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940611.826218:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1baad5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875839738287744:0@lo:8:kworker.0 00000100:00100000:1.0:1788940611.826245:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940611.826268:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1baad4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875839738287872:0@lo:8:kworker.0 00000100:00100000:1.0:1788940611.826285:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940611.826347:0:15139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738287744 00000100:00100000:1.0:1788940611.826352:0:15139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738287744 00000100:00100000:1.0:1788940611.826367:0:15139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738287872 00000100:00100000:1.0:1788940611.826370:0:15139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738287872 00000100:00100000:1.0:1788940611.826380:0:15139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788940611.826385:0:15139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1baad5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3304:x1875839738287744:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788940611.826411:0:15139:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 554 last 0 00000020:00000080:1.0:1788940611.826440:0:15139:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x27a633fcdd4bc6e 00002000:00100000:1.0:1788940611.826454:0:15139:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff89f1bee99800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788940611.826459:0:15139:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788940611.826462:0:15139:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1788940611.826871:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738287616 00000100:00100000:0.0:1788940611.826877:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738287616 00000100:00100000:0.0:1788940611.826922:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788940611.826930:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1af526450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+16:3305:x1875839738287616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940611.826977:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1af526450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+16:3305:x1875839738287616:12345-0@lo:400:kworker.0 Request processed in 48us (1601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940611.826984:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788940611.827079:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738288128 00000100:00100000:3.0:1788940611.827084:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738288128 00000100:00100000:3.0:1788940611.827121:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788940611.827129:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1baad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875839738288128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940611.827170:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1baad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875839738288128:12345-0@lo:400:kworker.0 Request processed in 42us (1001us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940611.827176:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788940611.827211:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89f1baad6300 x1875839738288128/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940627 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940611.827234:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1baad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875839738288128:0@lo:400:kworker.0 00000100:00100000:3.0:1788940611.827262:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1baad4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3305:1875839738287616:0@lo:400:kworker.0 00002000:00080000:1.0:1788940611.828034:0:15139:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788940611.828070:0:15139:0:(import.c:65:import_set_state_nolock()) ffff89f1bee9f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788940611.828181:0:15139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1baad5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1875839738287744:12345-0@lo:8:kworker.0 Request processed in 1793us (1933us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940611.828190:0:15139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788940611.828211:0:15139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788940611.828216:0:15139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1baad4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3304:x1875839738287872:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788940611.828232:0:15139:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788940611.828261:0:15139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1baad4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3304:x1875839738287872:12345-0@lo:8:kworker.0 Request processed in 44us (1974us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788940611.828267:0:15139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788940611.842964:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89f1baad5f80 x1875839738287744/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788940631 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940611.842983:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788940611.842996:0:3304:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788940611.843005:0:3304:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788940611.843011:0:3304:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788940611.843016:0:3304:0:(import.c:65:import_set_state_nolock()) ffff89f194b4f800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788940611.843045:0:3304:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788940611.843052:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1baad5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875839738287744:0@lo:8:kworker.0 00000100:00080000:0.0:1788940611.843072:0:3304:0:(import.c:65:import_set_state_nolock()) ffff89f192361800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788940611.843078:0:3304:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788940611.843081:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1baad4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875839738287872:0@lo:8:kworker.0 00000004:00080000:1.0:1788940611.843211:0:14476:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788940611.843665:0:14476:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 554742145157ns, next at 0ns, rc = 0 00000004:00080000:2.0:1788940611.844134:0:14477:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:2.0:1788940611.844161:0:14477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ba974000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14477:1875839738288384:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788940611.844225:0:14477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940611.844254:0:14477:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f184151d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788940611.844269:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ba974700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738288256:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788940611.844295:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940611.852713:0:15141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738288384 00000100:00100000:0.0:1788940611.852728:0:15141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738288384 00000100:00100000:0.0:1788940611.852813:0:15141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788940611.852824:0:15141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ba975500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14477:x1875839738288384:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788940611.862339:0:15141:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1788940611.862354:0:15141:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1788940611.862360:0:15141:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00000100:00080000:1.0:1788940611.865584:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788940611.867741:0:15142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738288256 00000100:00100000:3.0:1788940611.867762:0:15142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738288256 00000100:00100000:3.0:1788940611.867827:0:15142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788940611.867837:0:15142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ba974a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1875839738288256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788940611.867876:0:15142:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788940611.867968:0:15142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ba974a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1875839738288256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (23671us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940611.867975:0:15142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788940611.870823:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89f1ba974700 x1875839738288256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940627 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940611.870882:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ba974700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738288256:0@lo:13:osp-pre-0-0.0 00002000:00010000:0.0:1788940611.873204:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788940611.873217:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c32fc787/0x27a633fcdd4bc75 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.873242:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=554s v=(0 0) 00010000:00010000:0.0:1788940611.873248:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940611.873255:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c32fc787/0x27a633fcdd4bc75 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.873275:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c32fc787/0x27a633fcdd4bc75 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.873287:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c32fc787/0x27a633fcdd4bc75 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.873297:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c32fc787/0x27a633fcdd4bc75 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.873343:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788940611.877552:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940611.877567:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c32fc787/0x27a633fcdd4bc75 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940611.877580:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad2c00 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:1.0:1788940611.877585:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c32fc787/0x27a633fcdd4bc75 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940611.877598:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c32fc787/0x27a633fcdd4bc75 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940611.877628:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c32fc787/0x27a633fcdd4bc75 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940611.877636:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c32fc787/0x27a633fcdd4bc75 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940611.877669:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940611.877672:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940611.877674:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788940611.894168:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788940611.894186:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa3d0aa6/0x27a633fcdd4bc7c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.894204:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=554s v=(0 0) 00010000:00010000:0.0:1788940611.894209:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940611.894215:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa3d0aa6/0x27a633fcdd4bc7c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.894230:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa3d0aa6/0x27a633fcdd4bc7c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.894255:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa3d0aa6/0x27a633fcdd4bc7c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.894263:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aa3d0aa6/0x27a633fcdd4bc7c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.894289:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788940611.894316:0:14442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940611.894323:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa3d0aa6/0x27a633fcdd4bc7c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.894331:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad3a00 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:0.0:1788940611.894335:0:14442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa3d0aa6/0x27a633fcdd4bc7c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.894344:0:14442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa3d0aa6/0x27a633fcdd4bc7c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.894362:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa3d0aa6/0x27a633fcdd4bc7c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.894370:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa3d0aa6/0x27a633fcdd4bc7c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.894391:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940611.894398:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940611.894400:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788940611.895796:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788940611.895807:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001027ef0e/0x27a633fcdd4bc83 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.895821:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=554s v=(0 0) 00010000:00010000:0.0:1788940611.895826:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940611.895833:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001027ef0e/0x27a633fcdd4bc83 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.895845:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001027ef0e/0x27a633fcdd4bc83 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.895854:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001027ef0e/0x27a633fcdd4bc83 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.895862:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001027ef0e/0x27a633fcdd4bc83 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.895881:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788940611.895892:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940611.895898:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001027ef0e/0x27a633fcdd4bc83 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.895906:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad3e00 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:0.0:1788940611.895910:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001027ef0e/0x27a633fcdd4bc83 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.895932:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001027ef0e/0x27a633fcdd4bc83 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.895949:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001027ef0e/0x27a633fcdd4bc83 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.895957:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001027ef0e/0x27a633fcdd4bc83 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.895975:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940611.895977:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940611.895978:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788940611.896440:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788940611.896447:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c14f4f2e/0x27a633fcdd4bc8a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.896458:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=554s v=(0 0) 00010000:00010000:0.0:1788940611.896462:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940611.896466:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c14f4f2e/0x27a633fcdd4bc8a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.896476:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c14f4f2e/0x27a633fcdd4bc8a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.896485:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c14f4f2e/0x27a633fcdd4bc8a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.896499:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c14f4f2e/0x27a633fcdd4bc8a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.896514:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788940611.896547:0:14442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940611.896551:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c14f4f2e/0x27a633fcdd4bc8a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.896560:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad2400 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:0.0:1788940611.896563:0:14442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c14f4f2e/0x27a633fcdd4bc8a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.896572:0:14442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c14f4f2e/0x27a633fcdd4bc8a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.896584:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c14f4f2e/0x27a633fcdd4bc8a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.896592:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c14f4f2e/0x27a633fcdd4bc8a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.896607:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940611.896609:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940611.896611:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788940611.896983:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788940611.896996:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007fe69bf4/0x27a633fcdd4bc91 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.897006:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=554s v=(0 0) 00010000:00010000:0.0:1788940611.897009:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940611.897014:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007fe69bf4/0x27a633fcdd4bc91 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.897024:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007fe69bf4/0x27a633fcdd4bc91 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.897032:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007fe69bf4/0x27a633fcdd4bc91 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.897040:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007fe69bf4/0x27a633fcdd4bc91 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.897054:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788940611.897062:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940611.897067:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007fe69bf4/0x27a633fcdd4bc91 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.897074:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad2600 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:0.0:1788940611.897077:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007fe69bf4/0x27a633fcdd4bc91 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.897085:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007fe69bf4/0x27a633fcdd4bc91 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.897102:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007fe69bf4/0x27a633fcdd4bc91 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.897111:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007fe69bf4/0x27a633fcdd4bc91 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.897125:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940611.897127:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940611.897129:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788940611.907388:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788940611.907407:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000084c6126/0x27a633fcdd4bc98 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.907425:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=554s v=(0 0) 00010000:00010000:0.0:1788940611.907430:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940611.907436:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000084c6126/0x27a633fcdd4bc98 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.907451:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000084c6126/0x27a633fcdd4bc98 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.907463:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000084c6126/0x27a633fcdd4bc98 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.907471:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000084c6126/0x27a633fcdd4bc98 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.907504:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788940611.907539:0:14442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940611.907547:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000084c6126/0x27a633fcdd4bc98 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.907555:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad3000 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:0.0:1788940611.907560:0:14442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000084c6126/0x27a633fcdd4bc98 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.907570:0:14442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000084c6126/0x27a633fcdd4bc98 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.907591:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000084c6126/0x27a633fcdd4bc98 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.907600:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000084c6126/0x27a633fcdd4bc98 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.907630:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940611.907633:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940611.907635:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788940611.908288:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788940611.908296:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b243293f/0x27a633fcdd4bc9f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.908317:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=554s v=(0 0) 00010000:00010000:0.0:1788940611.908328:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940611.908334:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b243293f/0x27a633fcdd4bc9f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.908345:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b243293f/0x27a633fcdd4bc9f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.908354:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b243293f/0x27a633fcdd4bc9f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.908361:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b243293f/0x27a633fcdd4bc9f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.908380:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788940611.908393:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940611.908398:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b243293f/0x27a633fcdd4bc9f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.908405:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad2a00 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:0.0:1788940611.908409:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b243293f/0x27a633fcdd4bc9f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.908417:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b243293f/0x27a633fcdd4bc9f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.908430:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b243293f/0x27a633fcdd4bc9f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.908450:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b243293f/0x27a633fcdd4bc9f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.908471:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940611.908473:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940611.908475:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788940611.914272:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788940611.914290:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007659df10/0x27a633fcdd4bca6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.914322:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=554s v=(0 0) 00010000:00010000:0.0:1788940611.914328:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940611.914336:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007659df10/0x27a633fcdd4bca6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.914351:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007659df10/0x27a633fcdd4bca6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.914362:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007659df10/0x27a633fcdd4bca6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.914370:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007659df10/0x27a633fcdd4bca6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.914388:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788940611.914403:0:14442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940611.914415:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007659df10/0x27a633fcdd4bca6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.914424:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad2200 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:0.0:1788940611.914428:0:14442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007659df10/0x27a633fcdd4bca6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.914438:0:14442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007659df10/0x27a633fcdd4bca6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.914457:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007659df10/0x27a633fcdd4bca6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.914465:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007659df10/0x27a633fcdd4bca6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.914492:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940611.914494:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940611.914496:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788940611.919102:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788940611.919117:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c71178a2/0x27a633fcdd4bcad lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.919136:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=554s v=(0 0) 00010000:00010000:0.0:1788940611.919141:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940611.919150:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c71178a2/0x27a633fcdd4bcad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.919180:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c71178a2/0x27a633fcdd4bcad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.919193:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c71178a2/0x27a633fcdd4bcad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.919201:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c71178a2/0x27a633fcdd4bcad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.919219:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788940611.919232:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940611.919239:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c71178a2/0x27a633fcdd4bcad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.919246:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad3600 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:0.0:1788940611.919251:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c71178a2/0x27a633fcdd4bcad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.919261:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c71178a2/0x27a633fcdd4bcad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.919279:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c71178a2/0x27a633fcdd4bcad lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.919288:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c71178a2/0x27a633fcdd4bcad lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.919327:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940611.919329:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940611.919331:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788940611.919815:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788940611.919821:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa3d0aa6/0x27a633fcdd4bcb4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.919832:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=554s v=(0 0) 00010000:00010000:0.0:1788940611.919835:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940611.919840:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa3d0aa6/0x27a633fcdd4bcb4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.919849:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa3d0aa6/0x27a633fcdd4bcb4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.919858:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa3d0aa6/0x27a633fcdd4bcb4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.919866:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aa3d0aa6/0x27a633fcdd4bcb4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.919880:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788940611.919889:0:14442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940611.919894:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa3d0aa6/0x27a633fcdd4bcb4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.919913:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad3a00 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:0.0:1788940611.919918:0:14442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa3d0aa6/0x27a633fcdd4bcb4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.919927:0:14442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa3d0aa6/0x27a633fcdd4bcb4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.919939:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa3d0aa6/0x27a633fcdd4bcb4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.919947:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa3d0aa6/0x27a633fcdd4bcb4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.919961:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940611.919963:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940611.919965:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788940611.920344:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788940611.920351:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ae7562e/0x27a633fcdd4bcbb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.920361:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=554s v=(0 0) 00010000:00010000:0.0:1788940611.920365:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940611.920369:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ae7562e/0x27a633fcdd4bcbb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.920379:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ae7562e/0x27a633fcdd4bcbb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.920394:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ae7562e/0x27a633fcdd4bcbb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.920400:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ae7562e/0x27a633fcdd4bcbb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.920414:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788940611.920422:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940611.920426:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ae7562e/0x27a633fcdd4bcbb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.920434:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad3400 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:0.0:1788940611.920437:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ae7562e/0x27a633fcdd4bcbb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.920446:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ae7562e/0x27a633fcdd4bcbb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.920456:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ae7562e/0x27a633fcdd4bcbb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.920464:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ae7562e/0x27a633fcdd4bcbb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.920478:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940611.920486:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940611.920488:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788940611.920885:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788940611.920892:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058a522cf/0x27a633fcdd4bcc2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.920902:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=554s v=(0 0) 00010000:00010000:0.0:1788940611.920905:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940611.920910:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058a522cf/0x27a633fcdd4bcc2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.920921:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058a522cf/0x27a633fcdd4bcc2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.920930:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058a522cf/0x27a633fcdd4bcc2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.920938:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000058a522cf/0x27a633fcdd4bcc2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.920952:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788940611.920961:0:14442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940611.920965:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000058a522cf/0x27a633fcdd4bcc2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.920972:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1c21f1800 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:0.0:1788940611.920976:0:14442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000058a522cf/0x27a633fcdd4bcc2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.920994:0:14442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000058a522cf/0x27a633fcdd4bcc2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.921006:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000058a522cf/0x27a633fcdd4bcc2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.921014:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058a522cf/0x27a633fcdd4bcc2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.921028:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940611.921030:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940611.921032:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788940611.921434:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788940611.921441:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000023d3f7b/0x27a633fcdd4bcc9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.921451:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=554s v=(0 0) 00010000:00010000:0.0:1788940611.921454:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940611.921459:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000023d3f7b/0x27a633fcdd4bcc9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.921468:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000023d3f7b/0x27a633fcdd4bcc9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.921476:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000023d3f7b/0x27a633fcdd4bcc9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.921490:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000023d3f7b/0x27a633fcdd4bcc9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.921504:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788940611.921513:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940611.921543:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000023d3f7b/0x27a633fcdd4bcc9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.921552:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1c21f1000 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:0.0:1788940611.921555:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000023d3f7b/0x27a633fcdd4bcc9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.921565:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000023d3f7b/0x27a633fcdd4bcc9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.921577:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000023d3f7b/0x27a633fcdd4bcc9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.921586:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000023d3f7b/0x27a633fcdd4bcc9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.921599:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940611.921601:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940611.921603:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788940611.921986:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788940611.921999:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d21a33f6/0x27a633fcdd4bcd0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.922008:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=554s v=(0 0) 00010000:00010000:0.0:1788940611.922011:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940611.922016:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d21a33f6/0x27a633fcdd4bcd0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.922027:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d21a33f6/0x27a633fcdd4bcd0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.922036:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d21a33f6/0x27a633fcdd4bcd0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.922044:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d21a33f6/0x27a633fcdd4bcd0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.922058:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788940611.922066:0:14442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940611.922070:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d21a33f6/0x27a633fcdd4bcd0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.922077:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1c21f0200 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:0.0:1788940611.922081:0:14442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d21a33f6/0x27a633fcdd4bcd0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.922090:0:14442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d21a33f6/0x27a633fcdd4bcd0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.922109:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d21a33f6/0x27a633fcdd4bcd0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.922116:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d21a33f6/0x27a633fcdd4bcd0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.922130:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940611.922132:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940611.922134:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788940611.928350:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788940611.928363:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d09cd30/0x27a633fcdd4bcd7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.928382:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=554s v=(0 0) 00010000:00010000:0.0:1788940611.928387:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940611.928394:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d09cd30/0x27a633fcdd4bcd7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.928408:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d09cd30/0x27a633fcdd4bcd7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.928418:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d09cd30/0x27a633fcdd4bcd7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.928426:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d09cd30/0x27a633fcdd4bcd7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.928457:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788940611.928470:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940611.928476:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d09cd30/0x27a633fcdd4bcd7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.928483:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1c21f1e00 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:0.0:1788940611.928487:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d09cd30/0x27a633fcdd4bcd7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.928498:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d09cd30/0x27a633fcdd4bcd7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.928533:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d09cd30/0x27a633fcdd4bcd7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.928542:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d09cd30/0x27a633fcdd4bcd7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.928563:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940611.928565:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940611.928567:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788940611.929093:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788940611.929100:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b4a52a0/0x27a633fcdd4bcde lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.929109:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=554s v=(0 0) 00010000:00010000:0.0:1788940611.929118:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940611.929123:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b4a52a0/0x27a633fcdd4bcde lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.929133:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b4a52a0/0x27a633fcdd4bcde lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.929142:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b4a52a0/0x27a633fcdd4bcde lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.929149:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b4a52a0/0x27a633fcdd4bcde lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.929163:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788940611.929172:0:14442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940611.929176:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b4a52a0/0x27a633fcdd4bcde lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.929183:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1c21f1200 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:0.0:1788940611.929187:0:14442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b4a52a0/0x27a633fcdd4bcde lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.929194:0:14442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b4a52a0/0x27a633fcdd4bcde lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.929205:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b4a52a0/0x27a633fcdd4bcde lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.929223:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b4a52a0/0x27a633fcdd4bcde lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.929238:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940611.929240:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940611.929241:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788940611.929923:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788940611.929930:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd4f302b/0x27a633fcdd4bce5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.929940:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=554s v=(0 0) 00010000:00010000:0.0:1788940611.929943:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940611.929947:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd4f302b/0x27a633fcdd4bce5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.929955:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd4f302b/0x27a633fcdd4bce5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.929964:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd4f302b/0x27a633fcdd4bce5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.929971:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd4f302b/0x27a633fcdd4bce5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.929987:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788940611.929996:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940611.930007:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd4f302b/0x27a633fcdd4bce5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.930016:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1c21f0e00 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:0.0:1788940611.930020:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd4f302b/0x27a633fcdd4bce5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.930028:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd4f302b/0x27a633fcdd4bce5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.930040:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd4f302b/0x27a633fcdd4bce5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.930048:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd4f302b/0x27a633fcdd4bce5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.930064:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940611.930066:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940611.930067:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788940611.930493:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788940611.930499:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea1a10a6/0x27a633fcdd4bcec lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.930508:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=554s v=(0 0) 00010000:00010000:0.0:1788940611.930512:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940611.930538:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea1a10a6/0x27a633fcdd4bcec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.930560:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea1a10a6/0x27a633fcdd4bcec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.930570:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea1a10a6/0x27a633fcdd4bcec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.930578:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea1a10a6/0x27a633fcdd4bcec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.930592:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788940611.930601:0:14442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940611.930605:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea1a10a6/0x27a633fcdd4bcec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.930612:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1c21f0600 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:0.0:1788940611.930615:0:14442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea1a10a6/0x27a633fcdd4bcec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.930624:0:14442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea1a10a6/0x27a633fcdd4bcec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.930635:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea1a10a6/0x27a633fcdd4bcec lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.930641:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea1a10a6/0x27a633fcdd4bcec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.930661:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940611.930663:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940611.930665:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788940611.934275:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788940611.934287:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e56ac0f7/0x27a633fcdd4bcf3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.934304:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=554s v=(0 0) 00010000:00010000:0.0:1788940611.935904:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940611.935919:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e56ac0f7/0x27a633fcdd4bcf3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.935944:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e56ac0f7/0x27a633fcdd4bcf3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.935957:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e56ac0f7/0x27a633fcdd4bcf3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.935967:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e56ac0f7/0x27a633fcdd4bcf3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.935994:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788940611.936657:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788940611.936665:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a03bdf72/0x27a633fcdd4bcfa lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.936687:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=554s v=(0 0) 00010000:00010000:0.0:1788940611.936691:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940611.936696:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a03bdf72/0x27a633fcdd4bcfa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.936706:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a03bdf72/0x27a633fcdd4bcfa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.936716:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a03bdf72/0x27a633fcdd4bcfa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.936724:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a03bdf72/0x27a633fcdd4bcfa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.936745:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788940611.936761:0:14442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788940611.936767:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e56ac0f7/0x27a633fcdd4bcf3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.936776:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1c21f0a00 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:0.0:1788940611.936782:0:14442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e56ac0f7/0x27a633fcdd4bcf3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.936792:0:14442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e56ac0f7/0x27a633fcdd4bcf3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.936821:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e56ac0f7/0x27a633fcdd4bcf3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.936830:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e56ac0f7/0x27a633fcdd4bcf3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.936850:0:14442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940611.936854:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a03bdf72/0x27a633fcdd4bcfa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.936861:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f0812eb400 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:0.0:1788940611.936865:0:14442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a03bdf72/0x27a633fcdd4bcfa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.936873:0:14442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a03bdf72/0x27a633fcdd4bcfa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.936883:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a03bdf72/0x27a633fcdd4bcfa lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.936892:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a03bdf72/0x27a633fcdd4bcfa lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.936902:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940611.936904:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940611.936910:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788940611.937350:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788940611.937357:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005215e8ae/0x27a633fcdd4bd01 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.937366:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=554s v=(0 0) 00010000:00010000:0.0:1788940611.937370:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940611.937375:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005215e8ae/0x27a633fcdd4bd01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.937384:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005215e8ae/0x27a633fcdd4bd01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.937391:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005215e8ae/0x27a633fcdd4bd01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.937397:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005215e8ae/0x27a633fcdd4bd01 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.937413:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788940611.937422:0:14442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940611.937426:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005215e8ae/0x27a633fcdd4bd01 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.937433:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f0812eb600 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:0.0:1788940611.937436:0:14442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005215e8ae/0x27a633fcdd4bd01 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.937455:0:14442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005215e8ae/0x27a633fcdd4bd01 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.937466:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005215e8ae/0x27a633fcdd4bd01 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.937474:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005215e8ae/0x27a633fcdd4bd01 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.937489:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940611.937490:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940611.937492:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788940611.937925:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788940611.937933:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fd8a7d4/0x27a633fcdd4bd08 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.937943:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=554s v=(0 0) 00010000:00010000:0.0:1788940611.937946:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940611.937951:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004fd8a7d4/0x27a633fcdd4bd08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.937959:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004fd8a7d4/0x27a633fcdd4bd08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.937967:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fd8a7d4/0x27a633fcdd4bd08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.937984:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004fd8a7d4/0x27a633fcdd4bd08 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.937998:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788940611.938006:0:14442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940611.938010:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004fd8a7d4/0x27a633fcdd4bd08 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.938015:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f0812eba00 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:0.0:1788940611.938018:0:14442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004fd8a7d4/0x27a633fcdd4bd08 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.938026:0:14442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004fd8a7d4/0x27a633fcdd4bd08 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.938036:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004fd8a7d4/0x27a633fcdd4bd08 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.938043:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004fd8a7d4/0x27a633fcdd4bd08 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.938058:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940611.938060:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940611.938061:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788940611.938473:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788940611.938479:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcb2cc0d/0x27a633fcdd4bd0f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.938494:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=554s v=(0 0) 00010000:00010000:0.0:1788940611.938498:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940611.938503:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcb2cc0d/0x27a633fcdd4bd0f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.938514:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcb2cc0d/0x27a633fcdd4bd0f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.938549:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcb2cc0d/0x27a633fcdd4bd0f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.938556:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcb2cc0d/0x27a633fcdd4bd0f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.938570:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788940611.938580:0:14442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940611.938583:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcb2cc0d/0x27a633fcdd4bd0f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.938590:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f0812eac00 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:0.0:1788940611.938594:0:14442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcb2cc0d/0x27a633fcdd4bd0f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.938602:0:14442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcb2cc0d/0x27a633fcdd4bd0f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.938624:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcb2cc0d/0x27a633fcdd4bd0f lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.938631:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcb2cc0d/0x27a633fcdd4bd0f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.938645:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940611.938647:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940611.938649:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788940611.939034:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788940611.939040:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016a75094/0x27a633fcdd4bd16 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.939051:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=554s v=(0 0) 00010000:00010000:0.0:1788940611.939054:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940611.939059:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016a75094/0x27a633fcdd4bd16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.939070:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016a75094/0x27a633fcdd4bd16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.939080:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016a75094/0x27a633fcdd4bd16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.939088:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016a75094/0x27a633fcdd4bd16 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.939113:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788940611.939121:0:14442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940611.939125:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016a75094/0x27a633fcdd4bd16 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.939131:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f0812ea400 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:0.0:1788940611.939135:0:14442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016a75094/0x27a633fcdd4bd16 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.939143:0:14442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016a75094/0x27a633fcdd4bd16 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.939155:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016a75094/0x27a633fcdd4bd16 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.939163:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016a75094/0x27a633fcdd4bd16 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940611.939175:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940611.939176:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940611.939178:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940611.942256:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788940611.947221:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940611.947236:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e39ed41/0x27a633fcdd4bd1d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940611.947266:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=554s v=(0 0) 00010000:00010000:2.0:1788940611.947271:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940611.947279:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e39ed41/0x27a633fcdd4bd1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940611.947299:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e39ed41/0x27a633fcdd4bd1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940611.947323:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e39ed41/0x27a633fcdd4bd1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940611.947332:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e39ed41/0x27a633fcdd4bd1d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940611.947362:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788940611.947867:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940611.947874:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f265a45/0x27a633fcdd4bd24 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940611.947884:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=554s v=(0 0) 00010000:00010000:2.0:1788940611.947887:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940611.947891:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f265a45/0x27a633fcdd4bd24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940611.947900:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f265a45/0x27a633fcdd4bd24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940611.947920:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f265a45/0x27a633fcdd4bd24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940611.947927:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f265a45/0x27a633fcdd4bd24 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940611.947943:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788940611.947961:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788940611.947968:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e39ed41/0x27a633fcdd4bd1d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940611.947976:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188daa200 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:2.0:1788940611.947981:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e39ed41/0x27a633fcdd4bd1d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940611.947989:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e39ed41/0x27a633fcdd4bd1d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940611.948006:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e39ed41/0x27a633fcdd4bd1d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940611.948014:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e39ed41/0x27a633fcdd4bd1d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940611.948031:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940611.948041:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f265a45/0x27a633fcdd4bd24 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940611.948048:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188dabc00 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:2.0:1788940611.948051:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f265a45/0x27a633fcdd4bd24 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940611.948058:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f265a45/0x27a633fcdd4bd24 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940611.948069:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f265a45/0x27a633fcdd4bd24 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940611.948076:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f265a45/0x27a633fcdd4bd24 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940611.948089:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940611.948090:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940611.948092:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788940611.948540:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940611.948547:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d540d032/0x27a633fcdd4bd2b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940611.948557:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=554s v=(0 0) 00010000:00010000:2.0:1788940611.948561:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940611.948565:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d540d032/0x27a633fcdd4bd2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940611.948586:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d540d032/0x27a633fcdd4bd2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940611.948595:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d540d032/0x27a633fcdd4bd2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940611.948602:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d540d032/0x27a633fcdd4bd2b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940611.948617:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788940611.948626:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940611.948629:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d540d032/0x27a633fcdd4bd2b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940611.948637:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188dab600 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:2.0:1788940611.948640:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d540d032/0x27a633fcdd4bd2b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940611.948648:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d540d032/0x27a633fcdd4bd2b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940611.948661:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d540d032/0x27a633fcdd4bd2b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940611.948668:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d540d032/0x27a633fcdd4bd2b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940611.948688:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940611.948690:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940611.948692:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788940611.948872:0:15141:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:2.0:1788940611.948969:0:15141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ba975500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14477:x1875839738288384:12345-0@lo:5:osp-pre-0-0.0 Request processed in 96144us (104740us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940611.948983:0:15141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788940611.949050:0:14477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ba974000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14477:1875839738288384:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788940611.949069:0:14477:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:2.0:1788940611.949128:0:14477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ba974000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14477:1875839738288512:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788940611.949168:0:14477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940611.949215:0:14477:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f184151d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788940611.949232:0:15141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738288512 00000100:00100000:2.0:1788940611.949239:0:15141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738288512 00000100:00100000:2.0:1788940611.949281:0:15141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788940611.949290:0:15141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ba977800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14477:x1875839738288512:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788940611.949915:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:0.0:1788940611.950024:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788940611.951808:0:15141:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:3.0:1788940611.960860:0:15141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ba977800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14477:x1875839738288512:12345-0@lo:5:osp-pre-0-0.0 Request processed in 11562us (11682us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788940611.960892:0:15141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788940611.961144:0:14477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ba974000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14477:1875839738288512:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788940611.961164:0:14477:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:2.0:1788940612.273902:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788940612.585319:0:15509:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg214-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788940613.292933:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940614.319476:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788940615.292593:0:6732:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788940615.292620:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:0.0:1788940615.343293:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940616.366221:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940617.196837:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788940617.196862:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1baad7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738288640:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788940617.196945:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788940617.197011:0:36:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788940617.197018:0:36:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00100000:0.0:1788940617.197020:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4c27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3306:1875839738288768:0@lo:400:kworker.0 00000100:00080000:3.0:1788940617.197023:0:36:0:(import.c:65:import_set_state_nolock()) ffff89f192361800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788940617.197031:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 554 00000100:00080000:3.0:1788940617.197038:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788940617.197045:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff89f192361800 using connection 192.168.202.114@tcp/0@lo 00000100:00100000:0.0:1788940617.197066:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940617.197070:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89f1b4c27480 x1875839738288896/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788940617.197106:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4c27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875839738288896:0@lo:8:kworker.0 00000100:00100000:0.0:1788940617.197149:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940617.197187:0:15142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738288640 00000100:00100000:2.0:1788940617.197196:0:15142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738288640 00000100:00100000:2.0:1788940617.197249:0:15142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788940617.197275:0:15142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f083edca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738288640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788940617.197315:0:15142:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788940617.197360:0:15142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f083edca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738288640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940617.197367:0:15142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788940617.197465:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738288768 00000100:00100000:1.0:1788940617.197470:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738288768 00000100:00100000:1.0:1788940617.197500:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788940617.197535:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b53ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+16:3306:x1875839738288768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940617.197579:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b53ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+16:3306:x1875839738288768:12345-0@lo:400:kworker.0 Request processed in 63us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940617.197586:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788940617.197617:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4c26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875839738289152:0@lo:400:kworker.0 00000100:00100000:1.0:1788940617.197645:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788940617.197675:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788940617.197693:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738289152 00000100:00100000:1.0:1788940617.197696:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738289152 00000100:00100000:1.0:1788940617.197743:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788940617.197750:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1baad6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875839738289152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940617.197786:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1baad6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875839738289152:12345-0@lo:400:kworker.0 Request processed in 36us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940617.197792:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1788940617.197811:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788940617.197834:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89f1b4c26680 x1875839738289152/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940617.197847:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4c26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875839738289152:0@lo:400:kworker.0 00000100:00100000:1.0:1788940617.197883:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4c27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3306:1875839738288768:0@lo:400:kworker.0 00000100:00100000:1.0:1788940617.197895:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1788940617.197909:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1baad7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738288640:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788940617.198445:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4c26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875839738289024:0@lo:400:kworker.0 00000100:00100000:0.0:1788940617.198483:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940617.198616:0:15139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738288896 00000100:00100000:3.0:1788940617.198622:0:15139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738288896 00000100:00100000:3.0:1788940617.198657:0:15139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788940617.198665:0:15139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f083eddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3304:x1875839738288896:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788940617.198682:0:15139:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788940617.201981:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738289024 00000100:00100000:1.0:1788940617.201997:0:14456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738289024 00000100:00100000:1.0:1788940617.202058:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788940617.202068:0:14456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f083edf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875839738289024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940617.202178:0:14456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f083edf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875839738289024:12345-0@lo:400:kworker.0 Request processed in 112us (3693us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940617.202198:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1788940617.202248:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89f1b4c26d80 x1875839738289024/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940617.202273:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4c26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875839738289024:0@lo:400:kworker.0 00000100:00100000:0.0:1788940617.240723:0:15139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f083eddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3304:x1875839738288896:12345-0@lo:8:kworker.0 Request processed in 42052us (43568us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788940617.240737:0:15139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1788940617.240832:0:3304:0:(import.c:65:import_set_state_nolock()) ffff89f192361800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788940617.240839:0:3304:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788940617.240844:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4c27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875839738288896:0@lo:8:kworker.0 00010000:00010000:0.0:1788940617.388863:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940618.415749:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788940619.253824:0:14488:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788940619.437265:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940620.460800:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940621.484828:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788940621.992645:0:15860:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788940621.992650:0:15860:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1788940621.992772:0:15860:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff89f1b69b5800 00000020:01000004:3.0:1788940621.992791:0:15860:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788940621.992806:0:15860:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1788940621.992821:0:15860:0:(genops.c:415:class_newdev()) Allocate new device lustre-OST0001-osd (ffff89f1b6a20000) 00000020:00000080:3.0:1788940621.992840:0:15860:0:(obd_config.c:786:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788940622.008383:0:15860:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788940622.008689:0:15860:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788940622.009413:0:15860:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788940622.009810:0:15860:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1788940622.010021:0:15860:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1788940622.010370:0:15860:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 529: rc = 0 00100000:10000000:3.0:1788940622.010468:0:15860:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 529: rc = 0 00100000:10000000:3.0:1788940622.010764:0:15860:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 529: rc = 0 00100000:10000000:3.0:1788940622.011757:0:15860:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 726: rc = 0 00100000:10000000:3.0:1788940622.012036:0:15860:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 726: rc = 0 00100000:10000000:3.0:1788940622.012387:0:15860:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 726: rc = 0 00100000:10000000:3.0:1788940622.012723:0:15860:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 726: rc = 0 00100000:10000000:3.0:1788940622.012975:0:15860:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 726: rc = 0 00100000:10000000:3.0:1788940622.013303:0:15860:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 726: rc = 0 00000020:00000080:3.0:1788940622.014035:0:15860:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788940622.014048:0:15860:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788940622.014065:0:15860:0:(genops.c:1393:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x27a633fcdd4bd39 00000020:01000004:3.0:1788940622.014076:0:15860:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1788940622.014097:0:15860:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.114@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788940622.014100:0:15860:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.114@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788940622.014107:0:15860:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788940622.014129:0:15860:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1788940622.014133:0:15860:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.114@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788940622.023032:0:15860:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.114@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788940622.023070:0:15860:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.114@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1788940622.023074:0:15860:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788940622.023076:0:15860:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788940622.023077:0:15860:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788940622.023079:0:15860:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788940622.023080:0:15860:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788940622.023081:0:15860:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788940622.023082:0:15860:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788940622.023084:0:15860:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788940622.023085:0:15860:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788940622.023088:0:15860:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1788940622.023090:0:15860:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788940622.023091:0:15860:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788940622.023092:0:15860:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788940622.023093:0:15860:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788940622.023094:0:15860:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788940622.023095:0:15860:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788940622.023096:0:15860:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788940622.023097:0:15860:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788940622.023099:0:15860:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788940622.023123:0:15860:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788940622.023143:0:15860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ba977100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15860:1875839738289280:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788940622.023495:0:15860:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940622.023689:0:15860:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1b4c86840 going to sleep for 11 seconds 00000100:00100000:0.0:1788940622.023785:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738289280 00000100:00100000:0.0:1788940622.023794:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738289280 00000100:00100000:0.0:1788940622.023888:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788940622.023899:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b53ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+16:15860:x1875839738289280:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788940622.023933:0:14448:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788940622.023936:0:14448:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1788940622.023941:0:14448:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788940622.029608:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b53ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+16:15860:x1875839738289280:12345-0@lo:253:mount.lustre.0 Request processed in 5703us (6105us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940622.029623:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788940622.029795:0:15860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ba977100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15860:1875839738289280:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788940622.029811:0:15860:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788940622.029814:0:15860:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788940622.029816:0:15860:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788940622.029818:0:15860:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788940622.029819:0:15860:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788940622.029820:0:15860:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788940622.029821:0:15860:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788940622.029823:0:15860:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788940622.029825:0:15860:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788940622.029826:0:15860:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788940622.029849:0:15860:0:(tgt_mount.c:101:server_register_mount()) register mount ffff89f1b69b5800 from lustre-OST0001 10000000:01000000:3.0:1788940622.029878:0:15860:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788940622.029881:0:15860:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788940622.029889:0:15860:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff89f1b5c78000 local copy 00010000:00010000:3.0:1788940622.029900:0:15860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f082ad2000/0x27a633fcdd4bae6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4baed expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940622.030133:0:15860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4c27480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15860:1875839738289408:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788940622.030170:0:15860:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940622.030294:0:15860:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1834e3780 going to sleep for 11 seconds 00000100:00100000:1.0:1788940622.030359:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738289408 00000100:00100000:1.0:1788940622.030366:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738289408 00000100:00100000:1.0:1788940622.030411:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788940622.030419:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b53af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+16:15860:x1875839738289408:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788940622.030628:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b53af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+16:15860:x1875839738289408:12345-0@lo:501:mount.lustre.0 Request processed in 209us (457us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788940622.030636:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788940622.030736:0:15860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4c27480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15860:1875839738289408:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788940622.030749:0:15860:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.114@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788940622.030904:0:15860:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.114@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788940622.030911:0:15860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f082ad2000/0x27a633fcdd4bae6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4baed expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940622.030933:0:15860:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f082ad2000/0x27a633fcdd4bae6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4baed expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940622.030958:0:15860:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff89f1b69b5800 10000000:01000000:0.0:1788940622.030963:0:15860:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788940622.030968:0:15860:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788940622.030971:0:15860:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788940622.030975:0:15860:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1788940622.030978:0:15860:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788940622.031002:0:15860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f0812ebc00/0x27a633fcdd4bd40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940622.031009:0:15860:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f0812ebc00/0x27a633fcdd4bd40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940622.031017:0:15860:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f0812ebc00/0x27a633fcdd4bd40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940622.031032:0:15860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f083edf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15860:1875839738289536:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788940622.031061:0:15860:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940622.031090:0:15860:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1841b30c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788940622.031297:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738289536 00000100:00100000:1.0:1788940622.031302:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738289536 00000100:00100000:1.0:1788940622.031339:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788940622.031347:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b53ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+16:15860:x1875839738289536:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788940622.031357:0:14448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940622.031370:0:14448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f19258d200/0x27a633fcdd4bd47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4bd40 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940622.031392:0:14448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f19258d200/0x27a633fcdd4bd47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4bd40 expref: 17 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940622.031403:0:14448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f19258d200/0x27a633fcdd4bd47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4bd40 expref: 17 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940622.031425:0:14448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f19258d200, rc 0) 00000100:00100000:1.0:1788940622.031458:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b53ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+17:15860:x1875839738289536:12345-0@lo:101:mount.lustre.0 Request processed in 112us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940622.031464:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788940622.031553:0:15860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f083edf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15860:1875839738289536:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788940622.031565:0:15860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f0812ebc00/0x27a633fcdd4bd40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4bd47 expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940622.031574:0:15860:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f0812ebc00/0x27a633fcdd4bd40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4bd47 expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788940622.032178:0:15860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1788940622.033743:0:15860:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788940622.034020:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1788940622.034069:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1788940622.034105:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1788940622.034150:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1788940622.034188:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1788940622.034305:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1788940622.034366:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1788940622.034373:0:15860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1788940622.034459:0:15860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f083edf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15860:1875839738289664:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788940622.034661:0:15860:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940622.034824:0:15860:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1841b3d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788940622.034870:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738289664 00000100:00100000:1.0:1788940622.034877:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738289664 00000100:00100000:1.0:1788940622.034955:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788940622.034965:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b53afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+17:15860:x1875839738289664:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788940622.035472:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b53afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+17:15860:x1875839738289664:12345-0@lo:501:mount.lustre.0 Request processed in 506us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940622.035481:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788940622.035585:0:15860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f083edf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15860:1875839738289664:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788940622.035627:0:15860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ba976680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15860:1875839738289792:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788940622.035686:0:15860:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940622.035912:0:15860:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1b4c86a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788940622.035977:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738289792 00000100:00100000:0.0:1788940622.035983:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738289792 00000100:00100000:0.0:1788940622.036011:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788940622.036019:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b53adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+17:15860:x1875839738289792:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788940622.036370:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b53adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+17:15860:x1875839738289792:12345-0@lo:503:mount.lustre.0 Request processed in 351us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940622.036378:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788940622.036553:0:15860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ba976680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15860:1875839738289792:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788940622.037249:0:15860:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788940622.037321:0:15860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ba976680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15860:1875839738289920:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788940622.037370:0:15860:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940622.037397:0:15860:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1b4c86a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788940622.037682:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738289920 00000100:00100000:0.0:1788940622.037689:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738289920 00000100:00100000:0.0:1788940622.037718:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788940622.037727:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b53ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+17:15860:x1875839738289920:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788940622.037932:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b53ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+17:15860:x1875839738289920:12345-0@lo:502:mount.lustre.0 Request processed in 205us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940622.037940:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788940622.038126:0:15860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ba976680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15860:1875839738289920:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788940622.038396:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1788940622.038446:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1788940622.038483:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1788940622.038558:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1788940622.038600:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1788940622.038637:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1788940622.038824:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1788940622.038870:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1788940622.038916:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1788940622.038952:0:15860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ba976680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15860:1875839738290048:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788940622.039005:0:15860:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940622.039037:0:15860:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1b4c86a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788940622.039129:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738290048 00000100:00100000:0.0:1788940622.039135:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738290048 00000100:00100000:0.0:1788940622.039165:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788940622.039174:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+17:15860:x1875839738290048:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788940622.039416:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+17:15860:x1875839738290048:12345-0@lo:502:mount.lustre.0 Request processed in 242us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940622.039423:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788940622.039799:0:15860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ba976680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15860:1875839738290048:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788940622.039876:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1788940622.039885:0:15860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1788940622.041152:0:15862:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788940622.041162:0:15862:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1788940622.041169:0:15862:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940622.041171:0:15862:0:(obd_config.c:1662:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788940622.041177:0:15862:0:(obd_config.c:1571:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788940622.041191:0:15862:0:(genops.c:415:class_newdev()) Allocate new device lustre-OST0001 (ffff89f1b51819d8) 00000020:00000080:1.0:1788940622.041301:0:15862:0:(obd_config.c:786:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788940622.041309:0:15862:0:(obd_config.c:1571:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788940622.041387:0:15862:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89f1b69b5800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788940622.041394:0:15862:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788940622.041401:0:15862:0:(genops.c:1393:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x27a633fcdd4bd55 00010000:00010000:1.0:1788940622.047098:0:15862:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1788940622.047990:0:15862:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:1.0:1788940622.050942:0:15862:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1788940622.053108:0:15862:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788940622.053122:0:15862:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788940622.053135:0:15862:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940622.053138:0:15862:0:(obd_config.c:1662:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788940622.053142:0:15862:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788940622.053146:0:15862:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940622.053148:0:15862:0:(obd_config.c:1662:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788940622.053151:0:15862:0:(obd_config.c:1571:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788940622.053153:0:15862:0:(obd_config.c:1636:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788940622.053155:0:15862:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788940622.053158:0:15862:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940622.053159:0:15862:0:(obd_config.c:1662:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788940622.053161:0:15862:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788940622.053163:0:15862:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940622.053164:0:15862:0:(obd_config.c:1662:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788940622.053167:0:15862:0:(obd_config.c:1571:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788940622.053248:0:15862:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788940622.053252:0:15862:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940622.053253:0:15862:0:(obd_config.c:1662:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788940622.053257:0:15862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1788940622.053896:0:15860:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1788940622.053924:0:15860:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788940622.053950:0:15860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f0812ebc00/0x27a633fcdd4bd40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4bd47 expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940622.053976:0:15860:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f0812ebc00/0x27a633fcdd4bd40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4bd47 expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940622.053986:0:15860:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89f1b69b5800 from 1 10000000:01000000:3.0:1788940622.053989:0:15860:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788940622.054025:0:15860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f1bfa96800/0x27a633fcdd4bd5c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940622.054033:0:15860:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f1bfa96800/0x27a633fcdd4bd5c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940622.054046:0:15860:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f1bfa96800/0x27a633fcdd4bd5c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940622.054072:0:15860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4c27480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15860:1875839738290176:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788940622.054145:0:15860:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940622.054187:0:15860:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1834e3f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788940622.054410:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738290176 00000100:00100000:1.0:1788940622.054419:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738290176 00000100:00100000:1.0:1788940622.054570:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788940622.054581:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+17:15860:x1875839738290176:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788940622.054596:0:14449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940622.054609:0:14449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f19258c400/0x27a633fcdd4bd63 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4bd5c expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940622.054643:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f19258c400/0x27a633fcdd4bd63 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4bd5c expref: 18 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940622.054656:0:14449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f19258c400/0x27a633fcdd4bd63 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4bd5c expref: 18 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940622.054838:0:14449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f19258c400, rc 0) 00000100:00100000:1.0:1788940622.054891:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+18:15860:x1875839738290176:12345-0@lo:101:mount.lustre.0 Request processed in 312us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940622.054898:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788940622.054987:0:15860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4c27480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15860:1875839738290176:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788940622.055003:0:15860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f1bfa96800/0x27a633fcdd4bd5c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4bd63 expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940622.055013:0:15860:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f1bfa96800/0x27a633fcdd4bd5c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4bd63 expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788940622.056087:0:15860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1788940622.056835:0:15860:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788940622.057090:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788940622.057137:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788940622.057503:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788940622.057513:0:15860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788940622.057620:0:15860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4c27480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15860:1875839738290304:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788940622.057763:0:15860:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940622.057807:0:15860:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1834e3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788940622.059356:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738290304 00000100:00100000:0.0:1788940622.059370:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738290304 00000100:00100000:0.0:1788940622.059425:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788940622.059435:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf59d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+18:15860:x1875839738290304:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788940622.059751:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf59d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+18:15860:x1875839738290304:12345-0@lo:501:mount.lustre.0 Request processed in 317us (1987us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940622.059758:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788940622.060376:0:15860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4c27480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15860:1875839738290304:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788940622.060428:0:15860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4c27480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15860:1875839738290432:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788940622.060478:0:15860:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940622.060550:0:15860:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1834e3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788940622.060906:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738290432 00000100:00100000:0.0:1788940622.060912:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738290432 00000100:00100000:0.0:1788940622.060949:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788940622.060957:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf59f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+18:15860:x1875839738290432:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788940622.061307:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf59f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+18:15860:x1875839738290432:12345-0@lo:503:mount.lustre.0 Request processed in 349us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940622.061315:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788940622.061372:0:15860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4c27480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15860:1875839738290432:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788940622.061959:0:15860:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788940622.062036:0:15860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f083edc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15860:1875839738290560:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788940622.062090:0:15860:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940622.062128:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738290560 00000100:00100000:0.0:1788940622.062141:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738290560 00000100:00100000:0.0:1788940622.062172:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788940622.062180:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf59dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+18:15860:x1875839738290560:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788940622.062353:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf59dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+18:15860:x1875839738290560:12345-0@lo:502:mount.lustre.0 Request processed in 172us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940622.062361:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788940622.062406:0:15860:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f188f2cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788940622.062423:0:15860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f083edc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15860:1875839738290560:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788940622.064423:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788940622.064500:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1788940622.064846:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1788940622.064884:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1788940622.064914:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1788940622.064963:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1788940622.064999:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1788940622.065034:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1788940622.065087:0:15860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f083edc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15860:1875839738290688:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788940622.065166:0:15860:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940622.065336:0:15860:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1b89436c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788940622.068501:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738290688 00000100:00100000:1.0:1788940622.068538:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738290688 00000100:00100000:1.0:1788940622.068597:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788940622.068607:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf59e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+18:15860:x1875839738290688:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788940622.068972:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf59e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+18:15860:x1875839738290688:12345-0@lo:502:mount.lustre.0 Request processed in 365us (3804us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940622.068980:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788940622.069079:0:15860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f083edc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15860:1875839738290688:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788940622.069282:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1788940622.069299:0:15860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1788940622.070353:0:15866:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788940622.070363:0:15866:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940622.070365:0:15866:0:(obd_config.c:1662:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788940622.070372:0:15866:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: general-ffff89f1b69b5800 00000020:00000080:1.0:1788940622.070375:0:15866:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788940622.070382:0:15866:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788940622.070384:0:15866:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940622.070385:0:15866:0:(obd_config.c:1662:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788940622.070388:0:15866:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788940622.070390:0:15866:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940622.070391:0:15866:0:(obd_config.c:1662:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788940622.070394:0:15866:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: general-ffff89f1b69b5800 00000020:00000080:1.0:1788940622.070396:0:15866:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788940622.072831:0:15866:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788940622.073453:0:15866:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940622.073458:0:15866:0:(obd_config.c:1662:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788940622.073464:0:15866:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788940622.073470:0:15866:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940622.073471:0:15866:0:(obd_config.c:1662:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788940622.073476:0:15866:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff89f1b69b5800 00000020:00000080:0.0:1788940622.073488:0:15866:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788940622.075337:0:15866:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788940622.075347:0:15866:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940622.075349:0:15866:0:(obd_config.c:1662:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788940622.075353:0:15866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1788940622.078773:0:15860:0:(obd_config.c:2244:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788940622.078817:0:15860:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788940622.080787:0:15860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f1bfa96800/0x27a633fcdd4bd5c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4bd63 expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940622.080805:0:15860:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f1bfa96800/0x27a633fcdd4bd5c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4bd63 expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940622.080888:0:15860:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788940622.080892:0:15860:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff89f1b69b5800 10000000:01000000:3.0:1788940622.080895:0:15860:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff89f1b69b5800 10000000:01000000:3.0:1788940622.080899:0:15860:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788940622.080905:0:15860:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff89f1b69b5800 from 1 10000000:01000000:3.0:1788940622.080907:0:15860:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788940622.080946:0:15860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97c00/0x27a633fcdd4bd6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940622.080955:0:15860:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97c00/0x27a633fcdd4bd6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940622.080981:0:15860:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97c00/0x27a633fcdd4bd6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940622.081005:0:15860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4c26d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15860:1875839738290816:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788940622.081072:0:15860:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940622.081118:0:15860:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1834e3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788940622.086600:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738290816 00000100:00100000:0.0:1788940622.086615:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738290816 00000100:00100000:0.0:1788940622.086680:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788940622.086690:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf59c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+18:15860:x1875839738290816:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788940622.086709:0:14449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940622.086729:0:14449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f0812ea600/0x27a633fcdd4bd71 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4bd6a expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940622.086770:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f0812ea600/0x27a633fcdd4bd71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4bd6a expref: 19 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940622.086784:0:14449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f0812ea600/0x27a633fcdd4bd71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4bd6a expref: 19 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940622.086793:0:14449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f0812ea600, rc 0) 00000100:00100000:0.0:1788940622.086873:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf59c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+19:15860:x1875839738290816:12345-0@lo:101:mount.lustre.0 Request processed in 185us (5800us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940622.086881:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788940622.086939:0:15860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4c26d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15860:1875839738290816:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788940622.086958:0:15860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97c00/0x27a633fcdd4bd6a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4bd71 expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940622.086971:0:15860:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97c00/0x27a633fcdd4bd6a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4bd71 expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788940622.087625:0:15860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1788940622.087931:0:15860:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788940622.088179:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788940622.088561:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1788940622.088606:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1788940622.088654:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1788940622.088838:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1788940622.088890:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1788940622.088930:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1788940622.088968:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1788940622.089021:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1788940622.089060:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1788940622.089095:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1788940622.089143:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1788940622.089178:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1788940622.089912:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1788940622.089978:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1788940622.090018:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1788940622.090054:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1788940622.090104:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1788940622.090140:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1788940622.090178:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1788940622.092434:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1788940622.092539:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1788940622.092575:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1788940622.092630:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1788940622.094348:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1788940622.094423:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1788940622.094493:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1788940622.094561:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1788940622.094599:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1788940622.095804:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:0.0:1788940622.095877:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:0.0:1788940622.095911:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:0.0:1788940622.095948:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:0.0:1788940622.096030:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:0.0:1788940622.096071:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:0.0:1788940622.096122:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:0.0:1788940622.096157:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:0.0:1788940622.097881:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:0.0:1788940622.097899:0:15860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1788940622.098022:0:15860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f083edc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15860:1875839738290944:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788940622.098101:0:15860:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940622.098146:0:15860:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f195ed3780 going to sleep for 11 seconds 00000100:00100000:1.0:1788940622.098262:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738290944 00000100:00100000:1.0:1788940622.098269:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738290944 00000100:00100000:1.0:1788940622.098318:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788940622.098327:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf59d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+19:15860:x1875839738290944:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788940622.098577:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf59d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+19:15860:x1875839738290944:12345-0@lo:501:mount.lustre.0 Request processed in 250us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940622.098594:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788940622.099822:0:15860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f083edc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15860:1875839738290944:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788940622.099876:0:15860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f083edc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15860:1875839738291072:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788940622.099930:0:15860:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940622.099960:0:15860:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f195ed3780 going to sleep for 11 seconds 00000100:00100000:1.0:1788940622.100298:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738291072 00000100:00100000:1.0:1788940622.100304:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738291072 00000100:00100000:1.0:1788940622.100342:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788940622.100351:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf59cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+19:15860:x1875839738291072:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788940622.101849:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf59cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+19:15860:x1875839738291072:12345-0@lo:503:mount.lustre.0 Request processed in 1492us (1911us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940622.101861:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788940622.102514:0:15860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f083edc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15860:1875839738291072:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788940622.105879:0:15860:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788940622.105979:0:15860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f083edc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15860:1875839738291200:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788940622.106062:0:15860:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940622.106110:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738291200 00000100:00100000:0.0:1788940622.106117:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738291200 00000100:00100000:0.0:1788940622.106166:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788940622.106174:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf59c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+19:15860:x1875839738291200:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788940622.109167:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf59c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+19:15860:x1875839738291200:12345-0@lo:502:mount.lustre.0 Request processed in 2985us (3097us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940622.109196:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788940622.110136:0:15860:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1b89436c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788940622.110169:0:15860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f083edc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15860:1875839738291200:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788940622.111184:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788940622.112354:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1788940622.112397:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1788940622.112461:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1788940622.112546:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1788940622.112602:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1788940622.112640:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1788940622.115977:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1788940622.116121:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1788940622.116161:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1788940622.116221:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1788940622.116279:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1788940622.116316:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1788940622.116350:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1788940622.116398:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1788940622.116435:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1788940622.116466:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1788940622.116510:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1788940622.116833:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1788940622.116869:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1788940622.116917:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1788940622.116952:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1788940622.116985:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1788940622.117035:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1788940622.117076:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1788940622.117134:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1788940622.117184:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1788940622.117234:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1788940622.117282:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1788940622.117334:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1788940622.117372:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1788940622.117408:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1788940622.117443:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1788940622.117493:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1788940622.118771:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1788940622.118864:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1788940622.118902:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1788940622.118940:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1788940622.118991:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1788940622.119030:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1788940622.119085:0:15860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1baad7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15860:1875839738291328:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788940622.119179:0:15860:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940622.119288:0:15860:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1a94ffc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788940622.121660:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738291328 00000100:00100000:0.0:1788940622.121685:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738291328 00000100:00100000:0.0:1788940622.121747:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788940622.121756:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf59d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+19:15860:x1875839738291328:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788940622.122052:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf59d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+19:15860:x1875839738291328:12345-0@lo:502:mount.lustre.0 Request processed in 297us (2873us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940622.122061:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788940622.122597:0:15860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1baad7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15860:1875839738291328:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788940622.122737:0:15860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1788940622.122753:0:15860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1788940622.124049:0:15871:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788940622.124066:0:15871:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff89f1b5180000) 00000020:00000080:1.0:1788940622.124089:0:15871:0:(obd_config.c:786:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1788940622.124159:0:15871:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89f1b69b5800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788940622.124164:0:15871:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89f1b69b5800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788940622.124167:0:15871:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89f1b69b5800 3 00010000:00080000:1.0:1788940622.124199:0:15871:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89f1bee98800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.114@tcp at head 00010000:00010000:1.0:1788940622.126819:0:15871:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:1.0:1788940622.127082:0:15871:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788940622.127119:0:15871:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788940622.127132:0:15871:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x27a633fcdd4bd7f 00000100:00080000:1.0:1788940622.127143:0:15871:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788940622.127150:0:15871:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89f1bee98800 using connection 192.168.202.114@tcp/0@lo 00000100:00100000:1.0:1788940622.127183:0:15871:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89f1baad5880 x1875839738291456/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788940622.127261:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1baad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1875839738291456:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788940622.127329:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788940622.127391:0:15871:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788940622.128613:0:38:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788940622.128619:0:38:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788940622.128622:0:38:0:(import.c:65:import_set_state_nolock()) ffff89f192361800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788940622.128635:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 560 00000100:00080000:2.0:1788940622.128640:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788940622.128646:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff89f192361800 using connection 192.168.202.114@tcp/0@lo 00000100:00100000:2.0:1788940622.129638:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89f1ba974e00 x1875839738291712/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788940622.129738:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ba974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875839738291712:0@lo:8:kworker.0 00000100:00100000:0.0:1788940622.129801:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940622.129871:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738291456 00000100:00100000:0.0:1788940622.129879:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738291456 00000100:00100000:0.0:1788940622.129916:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788940622.129924:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f083edc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1875839738291456:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788940622.129949:0:14454:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 565 last 0 00000020:00000080:0.0:1788940622.129998:0:14454:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x27a633fcdd4bd86 00000004:00100000:0.0:1788940622.130013:0:14454:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788940622.130045:0:14454:0:(import.c:65:import_set_state_nolock()) ffff89f1ae833000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788940622.130092:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f083edc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875839738291456:12345-0@lo:38:llog_process_th.0 Request processed in 167us (2762us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940622.130099:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788940622.130125:0:15140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738291712 00000100:00100000:0.0:1788940622.130129:0:15140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738291712 00000100:00100000:0.0:1788940622.130148:0:15140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788940622.130153:0:15140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f083edd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3304:x1875839738291712:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1788940622.130187:0:15140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f083edd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3304:x1875839738291712:12345-0@lo:8:kworker.0 Request processed in 33us (386us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788940622.130193:0:15140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788940622.130757:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788940622.130766:0:3304:0:(import.c:65:import_set_state_nolock()) ffff89f192361800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788940622.130771:0:3304:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788940622.130774:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ba974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875839738291712:0@lo:8:kworker.0 00010000:00080000:0.0:1788940622.130789:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89f1baad5880 x1875839738291456/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788940632 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940622.130798:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788940622.130803:0:3304:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1788940622.130809:0:3304:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788940622.130814:0:3304:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788940622.130816:0:3304:0:(import.c:65:import_set_state_nolock()) ffff89f1bee98800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788940622.130821:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1baad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1875839738291456:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788940622.131028:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ba976680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738291584:0@lo:400:kworker.0 00000100:00100000:3.0:1788940622.131077:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1788940622.131291:0:15871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:0.0:1788940622.131457:0:15141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738291584 00000100:00100000:0.0:1788940622.131470:0:15141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738291584 00000100:00100000:0.0:1788940622.131515:0:15141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788940622.131556:0:15141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4c27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738291584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940622.131606:0:15141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4c27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738291584:12345-0@lo:400:kworker.0 Request processed in 53us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940622.131612:0:15141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788940622.131632:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:01000000:0.0:1788940622.131650:0:15860:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788940622.131760:0:15860:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788940622.131777:0:15860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97c00/0x27a633fcdd4bd6a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4bd71 expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940622.131787:0:15860:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97c00/0x27a633fcdd4bd6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4bd71 expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788940622.131844:0:15860:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788940622.131846:0:15860:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788940622.131848:0:15860:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788940622.131849:0:15860:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788940622.131850:0:15860:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788940622.131851:0:15860:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788940622.131853:0:15860:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788940622.131855:0:15860:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788940622.131856:0:15860:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788940622.131859:0:15860:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1788940622.131861:0:15860:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788940622.131863:0:15860:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788940622.131864:0:15860:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788940622.131865:0:15860:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788940622.131866:0:15860:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788940622.131867:0:15860:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788940622.131868:0:15860:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788940622.131869:0:15860:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788940622.131870:0:15860:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788940622.131892:0:15860:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788940622.131906:0:15860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f083ede300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15860:1875839738291840:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788940622.131946:0:15860:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940622.131970:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738291840 00000100:00100000:0.0:1788940622.131974:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738291840 00000100:00100000:0.0:1788940622.132000:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788940622.132006:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf59f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+19:15860:x1875839738291840:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788940622.132043:0:14448:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788940622.132055:0:14448:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788940622.132821:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ba976680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738291584:0@lo:400:kworker.0 00000100:00100000:0.0:1788940622.133132:0:15860:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f190209b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788940622.133911:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1baad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875839738291968:0@lo:400:kworker.0 00000100:00100000:1.0:1788940622.133965:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940622.134002:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1baad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875839738292096:0@lo:400:kworker.0 00000100:00100000:1.0:1788940622.134021:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940622.134056:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738291968 00000100:00100000:1.0:1788940622.134062:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738291968 00000100:00100000:1.0:1788940622.134092:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738292096 00000100:00100000:1.0:1788940622.134095:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738292096 00000100:00100000:1.0:1788940622.134114:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788940622.134122:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1baad6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875839738291968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940622.134163:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1baad6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875839738291968:12345-0@lo:400:kworker.0 Request processed in 41us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940622.134169:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788940622.134182:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788940622.134188:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1baad7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875839738292096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940622.134226:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1baad7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875839738292096:12345-0@lo:400:kworker.0 Request processed in 38us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940622.134232:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1788940622.134500:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89f1baad7b80 x1875839738292096/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940638 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940622.134514:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1baad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875839738292096:0@lo:400:kworker.0 00010000:00080000:1.0:1788940622.134567:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89f1baad4000 x1875839738291968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940638 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940622.134593:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1baad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875839738291968:0@lo:400:kworker.0 00000100:00080000:0.0:1788940622.140352:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 20000000:01000000:2.0:1788940622.172837:0:14448:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788940622.172887:0:14448:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1788940622.175184:0:14470:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788940622.175195:0:14470:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788940622.175228:0:14470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89f1bfa97400/0x27a633fcdd4bd8d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940622.175247:0:14470:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89f188daa400/0x27a633fcdd4bc67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4bc60 expref: 19 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940622.175256:0:14470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89f1bfa97400/0x27a633fcdd4bd8d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940622.175301:0:14470:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89f188daa400/0x27a633fcdd4bc67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27a633fcdd4bc60 expref: 19 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940622.175333:0:14470:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89f188daa400/0x27a633fcdd4bc67 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27a633fcdd4bc60 expref: 19 pid: 14448 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940622.175347:0:14470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4c26680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14470:1875839738292224:0@lo:104: 00000100:00100000:3.0:1788940622.175411:0:14470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940622.175456:0:14470:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1834e3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788940622.175532:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738292224 00000100:00100000:0.0:1788940622.175541:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738292224 00000100:00100000:0.0:1788940622.175597:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788940622.175607:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4c25180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+3:14470:x1875839738292224:12345-0@lo:104: 00010000:00010000:0.0:1788940622.175619:0:14438:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff89f188daac00/0x27a633fcdd4bc60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4bc67 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940622.175681:0:14438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788940622.175688:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4c25180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+3:14470:x1875839738292224:12345-0@lo:104: Request processed in 82us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940622.175695:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788940622.175876:0:14470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4c26680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14470:1875839738292224:0@lo:104: 00010000:00010000:3.0:1788940622.175893:0:14470:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89f1bfa97400/0x27a633fcdd4bd8d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940622.176011:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940622.176018:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff89f188daac00/0x27a633fcdd4bc60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4bc67 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940622.176026:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188daac00 already unused, calling callback (ffffffffc1d10c20) 10000000:00010000:3.0:1788940622.176030:0:14443:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff89f188daac00/0x27a633fcdd4bc60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x27a633fcdd4bc67 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940622.176039:0:14443:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff89f188daac00/0x27a633fcdd4bc60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x27a633fcdd4bc67 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788940622.176046:0:14443:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff89f188daac00/0x27a633fcdd4bc60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x27a633fcdd4bc67 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940622.176052:0:14443:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788940622.176084:0:14443:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff89f188daac00/0x27a633fcdd4bc60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4bc67 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940622.176091:0:14443:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788940622.176128:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff89f188daac00/0x27a633fcdd4bc60 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4bc67 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940622.176136:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff89f188daac00/0x27a633fcdd4bc60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4bc67 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940622.176152:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940622.176154:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940622.176156:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940622.176163:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788940622.176173:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4c26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3307:1875839738292352:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788940622.176202:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940622.176483:0:14440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738292352 00000100:00100000:3.0:1788940622.176489:0:14440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738292352 00010000:00010000:3.0:1788940622.176509:0:14440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89f188daa400/0x27a633fcdd4bc67 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4bc60 expref: 20 pid: 14448 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940622.176552:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788940622.176560:0:14440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4c25f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+20:3307:x1875839738292352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788940622.176572:0:14440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940622.176577:0:14440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89f188daa400/0x27a633fcdd4bc67 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4bc60 expref: 20 pid: 14448 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940622.176586:0:14440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89f188daa400/0x27a633fcdd4bc67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27a633fcdd4bc60 expref: 20 pid: 14448 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940622.176601:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f188daa400/0x27a633fcdd4bc67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27a633fcdd4bc60 expref: 20 pid: 14448 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940622.176613:0:14440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89f1bfa97400/0x27a633fcdd4bd8d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940622.176628:0:14440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f1bfa97400/0x27a633fcdd4bd8d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788940622.176641:0:14440:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003605066s 00010000:00010000:3.0:1788940622.176646:0:14440:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89f1bfa97400/0x27a633fcdd4bd8d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940622.176652:0:14440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89f1bfa97400/0x27a633fcdd4bd8d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940622.176660:0:14440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89f1bfa97400/0x27a633fcdd4bd8d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940622.176773:0:14440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89f1bfa97400/0x27a633fcdd4bd8d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940622.176778:0:14440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1bfa97400 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:3.0:1788940622.176783:0:14440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89f1bfa97400/0x27a633fcdd4bd8d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940622.176791:0:14440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89f1bfa97400/0x27a633fcdd4bd8d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940622.176812:0:14440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89f1bfa97400/0x27a633fcdd4bd8d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940622.176822:0:14440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940622.176857:0:14440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4c25f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+19:3307:x1875839738292352:12345-0@lo:103:ldlm_bl.0 Request processed in 298us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940622.176864:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788940622.176901:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4c26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3307:1875839738292352:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788940622.176951:0:14470:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89f1bfa97400/0x27a633fcdd4bd8d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940622.176960:0:14470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89f1bfa97400/0x27a633fcdd4bd8d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940622.176966:0:14470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f1bfa97400/0x27a633fcdd4bd8d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940622.182499:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf59f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+18:15860:x1875839738291840:12345-0@lo:253:mount.lustre.0 Request processed in 50483us (50541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940622.182514:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788940622.182732:0:15860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f083ede300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:15860:1875839738291840:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788940622.182749:0:15860:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788940622.182752:0:15860:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788940622.182754:0:15860:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788940622.182755:0:15860:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788940622.182756:0:15860:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788940622.182757:0:15860:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788940622.182774:0:15860:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788940622.182775:0:15860:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788940622.182777:0:15860:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788940622.182778:0:15860:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788940622.182792:0:15860:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788940622.187419:0:15860:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788940622.188031:0:15860:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788940622.188201:0:15860:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788940622.189052:0:15860:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788940622.189225:0:15860:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788940622.189423:0:15860:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788940622.190344:0:15860:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1788940622.242861:0:15860:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788940622.242871:0:15860:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788940622.242904:0:15860:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788940622.242963:0:15860:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.114@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788940622.242982:0:15860:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788940622.243009:0:15860:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000100:00100000:3.0:1788940622.323898:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ba976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738292480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788940622.324207:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940622.324588:0:15142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738292480 00000100:00100000:2.0:1788940622.324600:0:15142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738292480 00000100:00100000:2.0:1788940622.324671:0:15142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788940622.324682:0:15142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4c26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738292480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788940622.324721:0:15142:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788940622.324800:0:15142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4c26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738292480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940622.324808:0:15142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788940622.325051:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ba976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738292480:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788940622.508926:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940623.532673:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788940623.790068:0:14451:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788940623.790078:0:14451:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff89f1b0c14800 from 8 10000000:01000000:0.0:1788940623.790084:0:14451:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788940623.790140:0:14451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f0812eae00/0x27a633fcdd4bd94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940623.790154:0:14451:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f0812eae00/0x27a633fcdd4bd94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940623.790167:0:14451:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f0812eae00/0x27a633fcdd4bd94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940623.790209:0:14451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f083ede300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14451:1875839738292608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788940623.790282:0:14451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940623.790344:0:14451:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f190ff5480 going to sleep for 11 seconds 00000100:00100000:2.0:1788940623.796004:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738292608 00000100:00100000:2.0:1788940623.796023:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738292608 00000100:00100000:2.0:1788940623.796094:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788940623.796107:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf59f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+18:14451:x1875839738292608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788940623.796124:0:14449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940623.796144:0:14449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f188daae00/0x27a633fcdd4bd9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4bd94 expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940623.796174:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f188daae00/0x27a633fcdd4bd9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4bd94 expref: 19 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940623.796186:0:14449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f188daae00/0x27a633fcdd4bd9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4bd94 expref: 19 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940623.796217:0:14449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f188daae00, rc 0) 00000100:00100000:2.0:1788940623.796301:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf59f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+19:14451:x1875839738292608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 196us (6017us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940623.796308:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788940623.802146:0:14451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f083ede300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14451:1875839738292608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788940623.802183:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f0812eae00/0x27a633fcdd4bd94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4bd9b expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940623.802206:0:14451:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f0812eae00/0x27a633fcdd4bd94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4bd9b expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940623.802295:0:14451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1baad4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14451:1875839738292736:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788940623.802366:0:14451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940623.802426:0:14451:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1863fab40 going to sleep for 11 seconds 00000100:00100000:1.0:1788940623.802448:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738292736 00000100:00100000:1.0:1788940623.802456:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738292736 00000100:00100000:1.0:1788940623.802513:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788940623.802542:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf59fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+19:14451:x1875839738292736:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788940623.802563:0:14446:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788940623.802580:0:14446:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788940623.802583:0:14446:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1788940623.802867:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf59fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+19:14451:x1875839738292736:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 326us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940623.802875:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788940623.802915:0:14451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1baad4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14451:1875839738292736:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788940623.803058:0:14451:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788940623.803066:0:14451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f0812eae00/0x27a633fcdd4bd94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4bd9b expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940623.803075:0:14451:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f0812eae00/0x27a633fcdd4bd94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4bd9b expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940624.564175:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940625.585791:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940626.605468:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788940627.437220:0:36:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788940627.437227:0:36:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788940627.437231:0:36:0:(import.c:65:import_set_state_nolock()) ffff89f192361800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788940627.437243:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff89f192361800 using connection 192.168.202.114@tcp/0@lo 00000100:00100000:3.0:1788940627.437268:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89f1b4c27b80 x1875839738293120/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788940627.437354:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4c24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875839738293376:0@lo:400:kworker.0 00000100:00100000:3.0:1788940627.437420:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940627.437472:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788940627.437478:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4c25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3305:1875839738292864:0@lo:400:kworker.0 00000100:00100000:3.0:1788940627.437506:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940627.437548:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4c24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875839738293504:0@lo:400:kworker.0 00000100:00100000:3.0:1788940627.437573:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940627.437609:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4c26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738292992:0@lo:400:kworker.0 00000100:00100000:3.0:1788940627.437633:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940627.437650:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788940627.437655:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4c27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875839738293248:0@lo:400:kworker.0 00000100:00100000:3.0:1788940627.437673:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940627.437696:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4c27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875839738293120:0@lo:8:kworker.0 00000100:00100000:3.0:1788940627.437717:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940627.437777:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738293376 00000100:00100000:3.0:1788940627.437785:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738293376 00000100:00100000:1.0:1788940627.438056:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738292864 00000100:00100000:1.0:1788940627.438072:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738292864 00000100:00100000:1.0:1788940627.438110:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788940627.438120:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b546f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+19:3305:x1875839738292864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940627.438183:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b546f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+19:3305:x1875839738292864:12345-0@lo:400:kworker.0 Request processed in 64us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940627.438190:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788940627.438232:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738293504 00000100:00100000:1.0:1788940627.438235:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738293504 00000100:00100000:1.0:1788940627.438255:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738293248 00000100:00100000:1.0:1788940627.438257:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738293248 00000100:00100000:1.0:1788940627.438270:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788940627.438276:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4c26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875839738293504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940627.438310:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4c26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875839738293504:12345-0@lo:400:kworker.0 Request processed in 34us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940627.438315:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788940627.438327:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788940627.438332:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b55aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875839738293248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940627.438358:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b55aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875839738293248:12345-0@lo:400:kworker.0 Request processed in 26us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940627.438363:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788940627.438382:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1baad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738293632:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788940627.438406:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788940627.438446:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1b4c27100 x1875839738293248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940643 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940627.438459:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4c27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875839738293248:0@lo:400:kworker.0 00000100:00100000:1.0:1788940627.438495:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4c25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3305:1875839738292864:0@lo:400:kworker.0 00010000:00080000:1.0:1788940627.438508:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1b4c24380 x1875839738293504/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940643 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940627.438533:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4c24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875839738293504:0@lo:400:kworker.0 00000100:00100000:1.0:1788940627.438576:0:15139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738292992 00000100:00100000:1.0:1788940627.438580:0:15139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738292992 00000100:00100000:1.0:1788940627.438614:0:15139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738293120 00000100:00100000:1.0:1788940627.438617:0:15139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738293120 00000100:00100000:1.0:1788940627.438628:0:15139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788940627.438634:0:15139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4c27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738292992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940627.438669:0:15139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4c27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738292992:12345-0@lo:400:kworker.0 Request processed in 35us (1034us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940627.438675:0:15139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788940627.438687:0:15139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788940627.438691:0:15139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b55aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3304:x1875839738293120:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788940627.438715:0:15139:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 570 last 0 00000020:00000080:1.0:1788940627.438756:0:15139:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x27a633fcdd4bda2 00002000:00100000:1.0:1788940627.438771:0:15139:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff89f08382b800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788940627.438776:0:15139:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788940627.438779:0:15139:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1788940627.439223:0:15142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738293632 00000100:00100000:2.0:1788940627.439228:0:15142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738293632 00000100:00100000:2.0:1788940627.439259:0:15142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788940627.439267:0:15142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1baad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738293632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788940627.439293:0:15142:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788940627.439330:0:15142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1baad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738293632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940627.439335:0:15142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00002000:00080000:1.0:1788940627.440486:0:15139:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788940627.440513:0:15139:0:(import.c:65:import_set_state_nolock()) ffff89f08382a800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788940627.440598:0:15139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b55aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1875839738293120:12345-0@lo:8:kworker.0 Request processed in 1904us (2878us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940627.440607:0:15139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788940627.440666:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1baad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738293632:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788940627.440680:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4c26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738292992:0@lo:400:kworker.0 00000100:00080000:1.0:1788940627.440725:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788940627.440729:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788940627.440785:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1b4c27b80 x1875839738293120/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788940652 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788940627.440798:0:3304:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00100000:3.0:1788940627.440936:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788940627.440948:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4c24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875839738293376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940627.440992:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4c24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875839738293376:12345-0@lo:400:kworker.0 Request processed in 49us (3571us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940627.440998:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1788940627.441031:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1b4c24000 x1875839738293376/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940643 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940627.441041:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4c24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875839738293376:0@lo:400:kworker.0 00000100:00080000:1.0:1788940627.444843:0:3304:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788940627.444868:0:3304:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788940627.444874:0:3304:0:(import.c:65:import_set_state_nolock()) ffff89f192361800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788940627.444901:0:3304:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788940627.444910:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4c27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875839738293120:0@lo:8:kworker.0 00000004:00080000:2.0:1788940627.451227:0:14479:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:2.0:1788940627.451259:0:14479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ba975c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14479:1875839738293888:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788940627.451327:0:14479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940627.451361:0:14479:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1baa6be40 going to sleep for 11 seconds 00000100:00100000:2.0:1788940627.451380:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ba975180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738293760:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788940627.451406:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940627.451445:0:15139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738293888 00000100:00100000:2.0:1788940627.451454:0:15139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738293888 00000100:00080000:1.0:1788940627.451704:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788940627.453029:0:15139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788940627.453046:0:15139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ba976300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14479:x1875839738293888:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788940627.456283:0:14478:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788940627.456603:0:14478:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 570355082879ns, next at 0ns, rc = 0 00000100:00100000:0.0:1788940627.456882:0:15142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738293760 00000100:00100000:0.0:1788940627.456893:0:15142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738293760 00000100:00100000:0.0:1788940627.456963:0:15142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788940627.456973:0:15142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ba976d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1875839738293760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788940627.457007:0:15142:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788940627.457188:0:15142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ba976d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1875839738293760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 216us (5780us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940627.457196:0:15142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788940627.457243:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1ba975180 x1875839738293760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940643 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940627.457274:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ba975180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738293760:0@lo:13:osp-pre-1-0.0 00002000:00080000:0.0:1788940627.481646:0:15139:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1788940627.481657:0:15139:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1788940627.481664:0:15139:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:0.0:1788940627.502308:0:15139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788940627.502321:0:15139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fd8a7d4/0x27a633fcdd4bda9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.502339:0:15139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=570s v=(0 0) 00010000:00010000:0.0:1788940627.502344:0:15139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940627.502351:0:15139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004fd8a7d4/0x27a633fcdd4bda9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.502379:0:15139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004fd8a7d4/0x27a633fcdd4bda9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.502391:0:15139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fd8a7d4/0x27a633fcdd4bda9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.502399:0:15139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004fd8a7d4/0x27a633fcdd4bda9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.502419:0:15139:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788940627.502433:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940627.502439:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004fd8a7d4/0x27a633fcdd4bda9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.502458:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f0812eba00 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:0.0:1788940627.502463:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004fd8a7d4/0x27a633fcdd4bda9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.502472:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004fd8a7d4/0x27a633fcdd4bda9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.502488:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004fd8a7d4/0x27a633fcdd4bda9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.502496:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004fd8a7d4/0x27a633fcdd4bda9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.502514:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940627.502555:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940627.502558:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788940627.503132:0:15139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788940627.503138:0:15139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcb2cc0d/0x27a633fcdd4bdb0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.503148:0:15139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=570s v=(0 0) 00010000:00010000:0.0:1788940627.503152:0:15139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940627.503157:0:15139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fcb2cc0d/0x27a633fcdd4bdb0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.503178:0:15139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fcb2cc0d/0x27a633fcdd4bdb0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.503193:0:15139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcb2cc0d/0x27a633fcdd4bdb0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.503202:0:15139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fcb2cc0d/0x27a633fcdd4bdb0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.503218:0:15139:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788940627.503228:0:14442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940627.503233:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fcb2cc0d/0x27a633fcdd4bdb0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.503240:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f0812eac00 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:0.0:1788940627.503244:0:14442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcb2cc0d/0x27a633fcdd4bdb0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.503253:0:14442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcb2cc0d/0x27a633fcdd4bdb0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.503266:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fcb2cc0d/0x27a633fcdd4bdb0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.503274:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fcb2cc0d/0x27a633fcdd4bdb0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.503292:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940627.503302:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940627.503305:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788940627.503922:0:15139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788940627.503929:0:15139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016a75094/0x27a633fcdd4bdb7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.503938:0:15139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=570s v=(0 0) 00010000:00010000:0.0:1788940627.503942:0:15139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940627.503946:0:15139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016a75094/0x27a633fcdd4bdb7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.503955:0:15139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016a75094/0x27a633fcdd4bdb7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.503963:0:15139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016a75094/0x27a633fcdd4bdb7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.503969:0:15139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000016a75094/0x27a633fcdd4bdb7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.503984:0:15139:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788940627.503994:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940627.503998:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000016a75094/0x27a633fcdd4bdb7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.504006:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f0812ea400 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:0.0:1788940627.504010:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000016a75094/0x27a633fcdd4bdb7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.504030:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000016a75094/0x27a633fcdd4bdb7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.504044:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000016a75094/0x27a633fcdd4bdb7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.504051:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016a75094/0x27a633fcdd4bdb7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.504065:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940627.504067:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940627.504069:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788940627.513954:0:15139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788940627.513964:0:15139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005215e8ae/0x27a633fcdd4bdbe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.513979:0:15139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=570s v=(0 0) 00010000:00010000:0.0:1788940627.513982:0:15139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940627.513987:0:15139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005215e8ae/0x27a633fcdd4bdbe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.513999:0:15139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005215e8ae/0x27a633fcdd4bdbe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.514006:0:15139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005215e8ae/0x27a633fcdd4bdbe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.514018:0:15139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005215e8ae/0x27a633fcdd4bdbe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.514037:0:15139:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788940627.514847:0:14442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940627.514858:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005215e8ae/0x27a633fcdd4bdbe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940627.514868:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f0812eb600 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:1.0:1788940627.514873:0:14442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005215e8ae/0x27a633fcdd4bdbe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940627.514884:0:14442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005215e8ae/0x27a633fcdd4bdbe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940627.514907:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005215e8ae/0x27a633fcdd4bdbe lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940627.514916:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005215e8ae/0x27a633fcdd4bdbe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940627.514936:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940627.514938:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940627.514940:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788940627.517223:0:15139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940627.517235:0:15139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000644c5e36/0x27a633fcdd4bdc5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.517260:0:15139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=570s v=(0 0) 00010000:00010000:2.0:1788940627.517265:0:15139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940627.517272:0:15139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000644c5e36/0x27a633fcdd4bdc5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.517286:0:15139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000644c5e36/0x27a633fcdd4bdc5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.517296:0:15139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000644c5e36/0x27a633fcdd4bdc5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.517303:0:15139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000644c5e36/0x27a633fcdd4bdc5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.517326:0:15139:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788940627.517738:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940627.517747:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000644c5e36/0x27a633fcdd4bdc5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.517758:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188daaa00 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:0.0:1788940627.517762:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000644c5e36/0x27a633fcdd4bdc5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.517773:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000644c5e36/0x27a633fcdd4bdc5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.517790:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000644c5e36/0x27a633fcdd4bdc5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.517798:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000644c5e36/0x27a633fcdd4bdc5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.517818:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940627.517820:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940627.517822:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788940627.518053:0:15139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940627.518059:0:15139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039303301/0x27a633fcdd4bdcc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.518069:0:15139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=570s v=(0 0) 00010000:00010000:2.0:1788940627.518073:0:15139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940627.518078:0:15139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039303301/0x27a633fcdd4bdcc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.518087:0:15139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039303301/0x27a633fcdd4bdcc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.518107:0:15139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039303301/0x27a633fcdd4bdcc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.518114:0:15139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000039303301/0x27a633fcdd4bdcc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.518171:0:15139:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788940627.519471:0:15139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940627.519483:0:15139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a5e6d01/0x27a633fcdd4bdd3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.519497:0:15139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=570s v=(0 0) 00010000:00010000:2.0:1788940627.519501:0:15139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940627.520974:0:15139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a5e6d01/0x27a633fcdd4bdd3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.520995:0:15139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a5e6d01/0x27a633fcdd4bdd3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.521006:0:15139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a5e6d01/0x27a633fcdd4bdd3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.521016:0:15139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a5e6d01/0x27a633fcdd4bdd3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940627.523812:0:14442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788940627.523843:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000039303301/0x27a633fcdd4bdcc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940627.523857:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188dab000 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:1.0:1788940627.523861:0:14442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000039303301/0x27a633fcdd4bdcc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940627.523873:0:14442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000039303301/0x27a633fcdd4bdcc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940627.523893:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000039303301/0x27a633fcdd4bdcc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940627.523901:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039303301/0x27a633fcdd4bdcc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940627.523921:0:14442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940627.523925:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a5e6d01/0x27a633fcdd4bdd3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940627.523931:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188daa600 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:1.0:1788940627.523934:0:14442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a5e6d01/0x27a633fcdd4bdd3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940627.523942:0:14442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a5e6d01/0x27a633fcdd4bdd3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940627.523965:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a5e6d01/0x27a633fcdd4bdd3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940627.523973:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940627.523974:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940627.523976:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940627.538147:0:15139:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788940627.538172:0:15139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a5e6d01/0x27a633fcdd4bdd3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788940627.539005:0:15139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940627.539016:0:15139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d76a193/0x27a633fcdd4bdda lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.539031:0:15139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=570s v=(0 0) 00010000:00010000:3.0:1788940627.539035:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940627.539036:0:15139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940627.539045:0:15139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d76a193/0x27a633fcdd4bdda lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.539060:0:15139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d76a193/0x27a633fcdd4bdda lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.539071:0:15139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d76a193/0x27a633fcdd4bdda lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.539079:0:15139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d76a193/0x27a633fcdd4bdda lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.539101:0:15139:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788940627.539548:0:15139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940627.539555:0:15139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008522e9f7/0x27a633fcdd4bde1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.539569:0:15139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=570s v=(0 0) 00010000:00010000:2.0:1788940627.539573:0:15139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940627.539577:0:15139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008522e9f7/0x27a633fcdd4bde1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.539588:0:15139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008522e9f7/0x27a633fcdd4bde1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.539596:0:15139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008522e9f7/0x27a633fcdd4bde1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.539603:0:15139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008522e9f7/0x27a633fcdd4bde1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.539618:0:15139:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788940627.541460:0:15139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940627.541472:0:15139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d540d032/0x27a633fcdd4bde8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.541485:0:15139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=570s v=(0 0) 00010000:00010000:2.0:1788940627.541491:0:15139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940627.541496:0:15139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d540d032/0x27a633fcdd4bde8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940627.541593:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788940627.541604:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d76a193/0x27a633fcdd4bdda lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940627.541625:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188daa400 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:3.0:1788940627.541630:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d76a193/0x27a633fcdd4bdda lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940627.541655:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d76a193/0x27a633fcdd4bdda lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940627.541675:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d76a193/0x27a633fcdd4bdda lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940627.541683:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d76a193/0x27a633fcdd4bdda lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940627.541703:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940627.541707:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008522e9f7/0x27a633fcdd4bde1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940627.541714:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188daac00 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:3.0:1788940627.541718:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008522e9f7/0x27a633fcdd4bde1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940627.541726:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008522e9f7/0x27a633fcdd4bde1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940627.541735:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008522e9f7/0x27a633fcdd4bde1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940627.541742:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008522e9f7/0x27a633fcdd4bde1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940627.541766:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940627.541767:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940627.541769:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940627.542296:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788940627.544365:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:2.0:1788940627.545596:0:15139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d540d032/0x27a633fcdd4bde8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.545638:0:15139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d540d032/0x27a633fcdd4bde8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.545647:0:15139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d540d032/0x27a633fcdd4bde8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.545681:0:15139:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788940627.548234:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940627.548248:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d540d032/0x27a633fcdd4bde8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940627.548261:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188dab600 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:3.0:1788940627.548267:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d540d032/0x27a633fcdd4bde8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940627.548278:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d540d032/0x27a633fcdd4bde8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940627.548297:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d540d032/0x27a633fcdd4bde8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940627.548305:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d540d032/0x27a633fcdd4bde8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940627.548329:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940627.548332:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940627.548334:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788940627.550775:0:15139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940627.550791:0:15139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f265a45/0x27a633fcdd4bdef lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.550809:0:15139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=570s v=(0 0) 00010000:00010000:2.0:1788940627.550814:0:15139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940627.550830:0:15139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f265a45/0x27a633fcdd4bdef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.550845:0:15139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f265a45/0x27a633fcdd4bdef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.550856:0:15139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f265a45/0x27a633fcdd4bdef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.550864:0:15139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f265a45/0x27a633fcdd4bdef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.550901:0:15139:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788940627.551077:0:14442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940627.551085:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f265a45/0x27a633fcdd4bdef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.551093:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188dabc00 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:0.0:1788940627.551097:0:14442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f265a45/0x27a633fcdd4bdef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.551107:0:14442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f265a45/0x27a633fcdd4bdef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.551123:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f265a45/0x27a633fcdd4bdef lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.551130:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f265a45/0x27a633fcdd4bdef lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.551149:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940627.551150:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940627.551152:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788940627.552232:0:15139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940627.552241:0:15139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a5e6d01/0x27a633fcdd4bdf6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.552255:0:15139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=570s v=(0 0) 00010000:00010000:2.0:1788940627.552260:0:15139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940627.552266:0:15139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a5e6d01/0x27a633fcdd4bdf6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.552277:0:15139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a5e6d01/0x27a633fcdd4bdf6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.552286:0:15139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a5e6d01/0x27a633fcdd4bdf6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.552293:0:15139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a5e6d01/0x27a633fcdd4bdf6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.552319:0:15139:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788940627.553728:0:15139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940627.553738:0:15139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e39ed41/0x27a633fcdd4bdfd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.553763:0:15139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=570s v=(0 0) 00010000:00010000:2.0:1788940627.553774:0:15139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940627.553780:0:15139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e39ed41/0x27a633fcdd4bdfd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.553793:0:15139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e39ed41/0x27a633fcdd4bdfd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.553801:0:15139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e39ed41/0x27a633fcdd4bdfd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.553807:0:15139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e39ed41/0x27a633fcdd4bdfd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.553834:0:15139:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788940627.554261:0:15139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940627.554268:0:15139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039303301/0x27a633fcdd4be04 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.554277:0:15139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=570s v=(0 0) 00010000:00010000:2.0:1788940627.554280:0:15139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940627.554284:0:15139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039303301/0x27a633fcdd4be04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.554295:0:15139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039303301/0x27a633fcdd4be04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.554304:0:15139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039303301/0x27a633fcdd4be04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.554317:0:15139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000039303301/0x27a633fcdd4be04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.554325:0:15139:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788940627.554562:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788940627.554571:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a5e6d01/0x27a633fcdd4bdf6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940627.554592:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188daa600 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:3.0:1788940627.554597:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a5e6d01/0x27a633fcdd4bdf6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940627.554607:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a5e6d01/0x27a633fcdd4bdf6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940627.554637:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a5e6d01/0x27a633fcdd4bdf6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940627.554646:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a5e6d01/0x27a633fcdd4bdf6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940627.554670:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788940627.554674:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e39ed41/0x27a633fcdd4bdfd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940627.554681:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188daa200 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:3.0:1788940627.554685:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e39ed41/0x27a633fcdd4bdfd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940627.554694:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e39ed41/0x27a633fcdd4bdfd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940627.554705:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e39ed41/0x27a633fcdd4bdfd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940627.554721:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e39ed41/0x27a633fcdd4bdfd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788940627.554727:0:15139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940627.554734:0:15139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000644c5e36/0x27a633fcdd4be0b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940627.554737:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940627.554744:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000039303301/0x27a633fcdd4be04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.554746:0:15139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=570s v=(0 0) 00010000:00010000:2.0:1788940627.554754:0:15139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940627.554758:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188dab000 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:2.0:1788940627.554761:0:15139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000644c5e36/0x27a633fcdd4be0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940627.554763:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000039303301/0x27a633fcdd4be04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940627.554789:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000039303301/0x27a633fcdd4be04 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.554789:0:15139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000644c5e36/0x27a633fcdd4be0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.554812:0:15139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000644c5e36/0x27a633fcdd4be0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940627.554817:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000039303301/0x27a633fcdd4be04 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.554831:0:15139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000644c5e36/0x27a633fcdd4be0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940627.554832:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039303301/0x27a633fcdd4be04 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.554854:0:15139:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788940627.554860:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940627.554865:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000644c5e36/0x27a633fcdd4be0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940627.554872:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188daaa00 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:3.0:1788940627.554882:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000644c5e36/0x27a633fcdd4be0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940627.554891:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000644c5e36/0x27a633fcdd4be0b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940627.554903:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000644c5e36/0x27a633fcdd4be0b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940627.554911:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000644c5e36/0x27a633fcdd4be0b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940627.554932:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940627.554935:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940627.554938:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940627.556855:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788940627.560136:0:15139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940627.560152:0:15139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009da99afd/0x27a633fcdd4be12 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.560188:0:15139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=570s v=(0 0) 00010000:00010000:2.0:1788940627.560193:0:15139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940627.560199:0:15139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009da99afd/0x27a633fcdd4be12 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.560215:0:15139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009da99afd/0x27a633fcdd4be12 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.560226:0:15139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009da99afd/0x27a633fcdd4be12 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.560233:0:15139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009da99afd/0x27a633fcdd4be12 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.560255:0:15139:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788940627.561112:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940627.561200:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009da99afd/0x27a633fcdd4be12 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940627.561215:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1829dbe00 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:3.0:1788940627.561221:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009da99afd/0x27a633fcdd4be12 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940627.561232:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009da99afd/0x27a633fcdd4be12 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940627.561255:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009da99afd/0x27a633fcdd4be12 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940627.561271:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009da99afd/0x27a633fcdd4be12 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940627.561297:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940627.561299:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940627.561301:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788940627.561442:0:15139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940627.561448:0:15139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000eecc37f/0x27a633fcdd4be19 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.561459:0:15139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=570s v=(0 0) 00010000:00010000:2.0:1788940627.561462:0:15139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940627.561468:0:15139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000eecc37f/0x27a633fcdd4be19 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.561478:0:15139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000eecc37f/0x27a633fcdd4be19 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.561496:0:15139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000eecc37f/0x27a633fcdd4be19 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.564043:0:15139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000eecc37f/0x27a633fcdd4be19 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.564081:0:15139:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788940627.564731:0:15139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940627.564738:0:15139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6de87ae/0x27a633fcdd4be20 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.565553:0:14442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940627.565562:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000eecc37f/0x27a633fcdd4be19 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.565573:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1829da200 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:0.0:1788940627.565577:0:14442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000eecc37f/0x27a633fcdd4be19 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.565600:0:14442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000eecc37f/0x27a633fcdd4be19 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.565618:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000eecc37f/0x27a633fcdd4be19 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.565625:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000eecc37f/0x27a633fcdd4be19 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.565643:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940627.565645:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940627.565647:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940627.565727:0:15139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=570s v=(0 0) 00010000:00010000:2.0:1788940627.565731:0:15139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940627.565737:0:15139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6de87ae/0x27a633fcdd4be20 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.565969:0:15139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6de87ae/0x27a633fcdd4be20 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.565981:0:15139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6de87ae/0x27a633fcdd4be20 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.565990:0:15139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d6de87ae/0x27a633fcdd4be20 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.566055:0:15139:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788940627.566649:0:15139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940627.566656:0:15139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d7ce0a0/0x27a633fcdd4be27 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.566666:0:15139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=570s v=(0 0) 00010000:00010000:2.0:1788940627.566669:0:15139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940627.566673:0:15139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d7ce0a0/0x27a633fcdd4be27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.566683:0:15139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d7ce0a0/0x27a633fcdd4be27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.566691:0:15139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d7ce0a0/0x27a633fcdd4be27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.566698:0:15139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009d7ce0a0/0x27a633fcdd4be27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.574430:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788940627.574446:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d6de87ae/0x27a633fcdd4be20 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.574460:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1829db800 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:0.0:1788940627.574466:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6de87ae/0x27a633fcdd4be20 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.574479:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6de87ae/0x27a633fcdd4be20 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.576882:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d6de87ae/0x27a633fcdd4be20 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.576930:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6de87ae/0x27a633fcdd4be20 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.576968:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940627.576973:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009d7ce0a0/0x27a633fcdd4be27 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.576982:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1829da600 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:0.0:1788940627.576987:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009d7ce0a0/0x27a633fcdd4be27 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.576998:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009d7ce0a0/0x27a633fcdd4be27 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.577017:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009d7ce0a0/0x27a633fcdd4be27 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.577024:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940627.577026:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940627.577030:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940627.577228:0:15139:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788940627.577235:0:15139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d7ce0a0/0x27a633fcdd4be27 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.577853:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788940627.578070:0:15139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940627.578077:0:15139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a57577d/0x27a633fcdd4be2e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.578094:0:15139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=570s v=(0 0) 00010000:00010000:2.0:1788940627.578098:0:15139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940627.578104:0:15139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a57577d/0x27a633fcdd4be2e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.578116:0:15139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a57577d/0x27a633fcdd4be2e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.578126:0:15139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a57577d/0x27a633fcdd4be2e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.578136:0:15139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a57577d/0x27a633fcdd4be2e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.578158:0:15139:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788940627.578578:0:15139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940627.578584:0:15139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007442b50f/0x27a633fcdd4be35 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.578593:0:15139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=570s v=(0 0) 00010000:00010000:2.0:1788940627.578596:0:15139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940627.578600:0:15139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007442b50f/0x27a633fcdd4be35 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.578609:0:15139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007442b50f/0x27a633fcdd4be35 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.578628:0:15139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007442b50f/0x27a633fcdd4be35 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.578636:0:15139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007442b50f/0x27a633fcdd4be35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.578648:0:15139:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788940627.578913:0:14442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788940627.578920:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a57577d/0x27a633fcdd4be2e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.578929:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1829daa00 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:0.0:1788940627.578939:0:14442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a57577d/0x27a633fcdd4be2e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.578949:0:14442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a57577d/0x27a633fcdd4be2e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.578964:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a57577d/0x27a633fcdd4be2e lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.578971:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a57577d/0x27a633fcdd4be2e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.578988:0:14442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940627.578991:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007442b50f/0x27a633fcdd4be35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.578997:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1829dbc00 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:0.0:1788940627.579000:0:14442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007442b50f/0x27a633fcdd4be35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.579006:0:14442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007442b50f/0x27a633fcdd4be35 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.579015:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007442b50f/0x27a633fcdd4be35 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.579022:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007442b50f/0x27a633fcdd4be35 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.579040:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940627.579042:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940627.579044:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940627.579052:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788940627.580140:0:15139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940627.580148:0:15139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a2169aa/0x27a633fcdd4be3c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.580169:0:15139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=570s v=(0 0) 00010000:00010000:2.0:1788940627.580173:0:15139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940627.580178:0:15139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a2169aa/0x27a633fcdd4be3c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.580188:0:15139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a2169aa/0x27a633fcdd4be3c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.580196:0:15139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a2169aa/0x27a633fcdd4be3c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.580202:0:15139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002a2169aa/0x27a633fcdd4be3c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.580224:0:15139:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788940627.580636:0:15139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940627.580642:0:15139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e4ea246/0x27a633fcdd4be43 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.580650:0:15139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=570s v=(0 0) 00010000:00010000:2.0:1788940627.580652:0:15139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940627.580656:0:15139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e4ea246/0x27a633fcdd4be43 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.580664:0:15139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007e4ea246/0x27a633fcdd4be43 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.580672:0:15139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e4ea246/0x27a633fcdd4be43 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.580679:0:15139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007e4ea246/0x27a633fcdd4be43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.580698:0:15139:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788940627.581185:0:14442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788940627.581192:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002a2169aa/0x27a633fcdd4be3c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.581200:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1829dae00 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:0.0:1788940627.581204:0:14442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002a2169aa/0x27a633fcdd4be3c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.581212:0:14442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002a2169aa/0x27a633fcdd4be3c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.581229:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002a2169aa/0x27a633fcdd4be3c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.581237:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a2169aa/0x27a633fcdd4be3c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.581253:0:14442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940627.581256:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007e4ea246/0x27a633fcdd4be43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.581261:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1829db200 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:0.0:1788940627.581271:0:14442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007e4ea246/0x27a633fcdd4be43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.581279:0:14442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007e4ea246/0x27a633fcdd4be43 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.581288:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007e4ea246/0x27a633fcdd4be43 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.581294:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e4ea246/0x27a633fcdd4be43 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.581307:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940627.581309:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940627.581310:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940627.584430:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788940627.587180:0:15139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940627.587193:0:15139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058fc74b4/0x27a633fcdd4be4a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.587212:0:15139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=570s v=(0 0) 00010000:00010000:2.0:1788940627.587230:0:15139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940627.587237:0:15139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058fc74b4/0x27a633fcdd4be4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.587253:0:15139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058fc74b4/0x27a633fcdd4be4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.587265:0:15139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058fc74b4/0x27a633fcdd4be4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.587272:0:15139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000058fc74b4/0x27a633fcdd4be4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.587298:0:15139:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788940627.587934:0:14442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940627.587942:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000058fc74b4/0x27a633fcdd4be4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.587952:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1829da800 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:0.0:1788940627.587957:0:14442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000058fc74b4/0x27a633fcdd4be4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.587966:0:14442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000058fc74b4/0x27a633fcdd4be4a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.587983:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000058fc74b4/0x27a633fcdd4be4a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.587998:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058fc74b4/0x27a633fcdd4be4a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.588021:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940627.588023:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940627.588025:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788940627.594374:0:15139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940627.594391:0:15139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000263f8369/0x27a633fcdd4be51 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.594409:0:15139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=570s v=(0 0) 00010000:00010000:2.0:1788940627.594413:0:15139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940627.594419:0:15139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000263f8369/0x27a633fcdd4be51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.594435:0:15139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000263f8369/0x27a633fcdd4be51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.594447:0:15139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000263f8369/0x27a633fcdd4be51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.594461:0:15139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000263f8369/0x27a633fcdd4be51 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.594491:0:15139:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788940627.595088:0:15139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940627.595096:0:15139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000345e0dc0/0x27a633fcdd4be58 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.595107:0:15139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=570s v=(0 0) 00010000:00010000:2.0:1788940627.595111:0:15139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940627.595116:0:15139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000345e0dc0/0x27a633fcdd4be58 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.595125:0:15139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000345e0dc0/0x27a633fcdd4be58 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.595134:0:15139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000345e0dc0/0x27a633fcdd4be58 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.595142:0:15139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000345e0dc0/0x27a633fcdd4be58 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.595173:0:15139:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788940627.595596:0:15139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940627.595602:0:15139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a32593d/0x27a633fcdd4be5f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.595617:0:15139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=570s v=(0 0) 00010000:00010000:2.0:1788940627.595620:0:15139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940627.595624:0:15139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a32593d/0x27a633fcdd4be5f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.595634:0:15139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a32593d/0x27a633fcdd4be5f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.595642:0:15139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a32593d/0x27a633fcdd4be5f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.595649:0:15139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a32593d/0x27a633fcdd4be5f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.595657:0:15139:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1788940627.596051:0:15139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940627.596058:0:15139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0fd90c5/0x27a633fcdd4be66 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.596067:0:15139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=570s v=(0 0) 00010000:00010000:2.0:1788940627.596070:0:15139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940627.596074:0:15139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0fd90c5/0x27a633fcdd4be66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.596083:0:15139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0fd90c5/0x27a633fcdd4be66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.596101:0:15139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0fd90c5/0x27a633fcdd4be66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.596107:0:15139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f0fd90c5/0x27a633fcdd4be66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940627.596115:0:15139:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00080000:2.0:1788940627.596291:0:15139:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:2.0:1788940627.596395:0:15139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ba976300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14479:x1875839738293888:12345-0@lo:5:osp-pre-1-0.0 Request processed in 143351us (145064us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940627.596405:0:15139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788940627.596468:0:14479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ba975c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14479:1875839738293888:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788940627.596485:0:14479:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:2.0:1788940627.596566:0:14479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ba975c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14479:1875839738294016:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788940627.596598:0:14479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940627.596641:0:14479:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1baa6be40 going to sleep for 11 seconds 00000100:00100000:2.0:1788940627.596659:0:15140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738294016 00000100:00100000:2.0:1788940627.596666:0:15140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738294016 00000100:00100000:2.0:1788940627.596703:0:15140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788940627.596711:0:15140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ba976680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14479:x1875839738294016:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788940627.596748:0:15140:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:0.0:1788940627.597232:0:14442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788940627.597241:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000263f8369/0x27a633fcdd4be51 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.597253:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1829db400 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:0.0:1788940627.597258:0:14442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000263f8369/0x27a633fcdd4be51 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.597270:0:14442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000263f8369/0x27a633fcdd4be51 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.597288:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000263f8369/0x27a633fcdd4be51 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.597296:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000263f8369/0x27a633fcdd4be51 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.597317:0:14442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788940627.597321:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000345e0dc0/0x27a633fcdd4be58 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.597339:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f181520200 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:0.0:1788940627.597342:0:14442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000345e0dc0/0x27a633fcdd4be58 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.597349:0:14442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000345e0dc0/0x27a633fcdd4be58 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.597359:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000345e0dc0/0x27a633fcdd4be58 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.597366:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000345e0dc0/0x27a633fcdd4be58 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.597380:0:14442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788940627.597383:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a32593d/0x27a633fcdd4be5f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.597389:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f181520c00 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:0.0:1788940627.597392:0:14442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a32593d/0x27a633fcdd4be5f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.597399:0:14442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a32593d/0x27a633fcdd4be5f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.597408:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a32593d/0x27a633fcdd4be5f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.597421:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a32593d/0x27a633fcdd4be5f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.597434:0:14442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940627.597437:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f0fd90c5/0x27a633fcdd4be66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.597444:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f181520000 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:0.0:1788940627.597448:0:14442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0fd90c5/0x27a633fcdd4be66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.597455:0:14442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0fd90c5/0x27a633fcdd4be66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.597464:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f0fd90c5/0x27a633fcdd4be66 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.597471:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0fd90c5/0x27a633fcdd4be66 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940627.597483:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940627.597484:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940627.597486:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940627.599363:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940627.627126:0:15140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ba976680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14479:x1875839738294016:12345-0@lo:5:osp-pre-1-0.0 Request processed in 30409us (30520us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788940627.627140:0:15140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1788940627.641307:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940627.644082:0:14479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ba975c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14479:1875839738294016:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788940627.644104:0:14479:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:3.0:1788940628.656468:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788940629.488276:0:14488:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788940629.679245:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788940630.040271:0:16216:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg214-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788940630.700684:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940631.734472:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940632.557690:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b55a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738294144:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788940632.557805:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940632.557892:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ba974700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875839738294656:0@lo:400:kworker.0 00000100:00100000:3.0:1788940632.557924:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940632.557929:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ba977100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738294400:0@lo:400:kworker.0 00000100:00100000:3.0:1788940632.557952:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788940632.557960:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ba974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3305:1875839738294272:0@lo:400:kworker.0 00000100:00100000:2.0:1788940632.557971:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940632.558001:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940632.558006:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf556300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875839738294912:0@lo:400:kworker.0 00000100:00100000:3.0:1788940632.558030:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ba975180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875839738294784:0@lo:400:kworker.0 00000100:00100000:2.0:1788940632.558042:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940632.558068:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788940632.558077:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940632.558196:0:15142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738294144 00000100:00100000:3.0:1788940632.558207:0:15142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738294144 00000100:00100000:2.0:1788940632.558362:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ba974000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738294528:0@lo:400:kworker.0 00000100:00100000:2.0:1788940632.558397:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788940632.558402:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788940632.558419:0:15142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788940632.558435:0:15142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b55aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1875839738294144:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788940632.558437:0:15139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738294400 00000100:00100000:2.0:1788940632.558442:0:15139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738294400 00000100:00100000:1.0:1788940632.558455:0:15141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738294528 00000100:00100000:1.0:1788940632.558459:0:15141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738294528 00000100:00100000:1.0:1788940632.558486:0:15141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00002000:00000024:3.0:1788940632.558487:0:15142:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788940632.558494:0:15141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf556680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738294400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940632.558562:0:15141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf556680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738294400:12345-0@lo:400:kworker.0 Request processed in 67us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940632.558571:0:15141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788940632.558593:0:15141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788940632.558598:0:15141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf557b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3307:x1875839738294528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940632.558619:0:15141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf557b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3307:x1875839738294528:12345-0@lo:400:kworker.0 Request processed in 22us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940632.558623:0:15141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788940632.558649:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738294272 00000100:00100000:2.0:1788940632.558653:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738294272 00000100:00100000:2.0:1788940632.558680:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788940632.558685:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b546d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+19:3305:x1875839738294272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940632.558717:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b546d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+19:3305:x1875839738294272:12345-0@lo:400:kworker.0 Request processed in 32us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940632.558722:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:2.0:1788940632.558744:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788940632.558758:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1baad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738295040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788940632.559453:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940632.559569:0:15143:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1788940632.559581:0:15143:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:0.0:1788940632.559715:0:15143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738295040 00000100:00100000:0.0:1788940632.559720:0:15143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738295040 00000100:00100000:0.0:1788940632.559806:0:16302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788940632.559817:0:16302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf557800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738295040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788940632.559849:0:16302:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788940632.559887:0:16302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf557800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738295040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940632.559891:0:16302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788940632.560219:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1baad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738295040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788940632.560868:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ba974000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738294528:0@lo:400:kworker.0 00000100:00100000:3.0:1788940632.560870:0:15142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b55aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1875839738294144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2436us (3066us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940632.560891:0:15142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788940632.560894:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ba977100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738294400:0@lo:400:kworker.0 00000100:00100000:3.0:1788940632.560926:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738294656 00000100:00100000:3.0:1788940632.560932:0:14456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738294656 00000100:00100000:2.0:1788940632.560954:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ba974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3305:1875839738294272:0@lo:400:kworker.0 00000100:00100000:3.0:1788940632.560958:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738294912 00000100:00100000:3.0:1788940632.560961:0:14456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738294912 00000100:00100000:3.0:1788940632.560989:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738294784 00000100:00100000:2.0:1788940632.560991:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b55a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738294144:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788940632.560992:0:14456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738294784 00000100:00100000:3.0:1788940632.561015:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788940632.561026:0:14456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b55a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875839738294656:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788940632.561036:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788940632.561078:0:14456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b55a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875839738294656:12345-0@lo:400:kworker.0 Request processed in 55us (3152us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940632.561085:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788940632.561099:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1788940632.561100:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1ba974700 x1875839738294656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940648 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940632.561106:0:14456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf555180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875839738294912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940632.561153:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ba974700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875839738294656:0@lo:400:kworker.0 00000100:00100000:3.0:1788940632.561376:0:14456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf555180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875839738294912:12345-0@lo:400:kworker.0 Request processed in 270us (3333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940632.561384:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788940632.561402:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788940632.561410:0:14456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b55ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875839738294784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940632.561449:0:14456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b55ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875839738294784:12345-0@lo:400:kworker.0 Request processed in 42us (3372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940632.561457:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1788940632.562076:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1ba975180 x1875839738294784/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940648 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940632.562087:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ba975180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875839738294784:0@lo:400:kworker.0 00010000:00080000:2.0:1788940632.568411:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1bf556300 x1875839738294912/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940648 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940632.568430:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf556300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875839738294912:0@lo:400:kworker.0 00000001:00100000:0.0:1788940632.672132:0:7662:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1788940632.672152:0:7662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:1.0:1788940632.750108:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940632.961209:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940632.961261:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718370048 00000100:00100000:3.0:1788940632.961275:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718370048 00000100:00100000:3.0:1788940632.961328:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 78 00000100:00100000:3.0:1788940632.961340:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b546c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2349:x1875839718370048:12345-192.168.202.14@tcp:250:mount.lustre.0 00010000:00080000:3.0:1788940632.961393:0:14449:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 584847da-857b-4e92-a9b9-d2025c0d7e63@192.168.202.14@tcp t0 exp 0000000000000000 cur 575 last 0 00000020:00000080:3.0:1788940632.961435:0:14449:0:(genops.c:1393:class_connect()) connect: client 584847da-857b-4e92-a9b9-d2025c0d7e63, cookie 0x27a633fcdd4be6d 00000100:00080000:3.0:1788940632.961653:0:14449:0:(import.c:65:import_set_state_nolock()) ffff89f083ecc000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788940632.961738:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b546c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:584847da-857b-4e92-a9b9-d2025c0d7e63+5:2349:x1875839718370048:12345-192.168.202.14@tcp:250:mount.lustre.0 Request processed in 399us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940632.961747:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 78 00000100:00100000:0.0:1788940632.972250:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940632.972309:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718370176 00000100:00100000:0.0:1788940632.972323:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718370176 00000100:00100000:0.0:1788940632.972392:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 79 00000100:00100000:0.0:1788940632.972404:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b546d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:584847da-857b-4e92-a9b9-d2025c0d7e63+5:13765:x1875839718370176:12345-192.168.202.14@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788940632.972427:0:14446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940632.972451:0:14446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f0812eb800/0x27a633fcdd4be74 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5b32 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940632.972488:0:14446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f0812eb800/0x27a633fcdd4be74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5b32 expref: 6 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940632.972502:0:14446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f0812eb800/0x27a633fcdd4be74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5b32 expref: 6 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940632.972552:0:14446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f0812eb800, rc 0) 00000100:00100000:0.0:1788940632.972624:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b546d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:584847da-857b-4e92-a9b9-d2025c0d7e63+6:13765:x1875839718370176:12345-192.168.202.14@tcp:101:mount.lustre.0 Request processed in 222us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940632.972631:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 79 00000100:00100000:1.0:1788940632.993957:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940632.994387:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718370304 00000100:00100000:2.0:1788940632.994402:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718370304 00000100:00100000:2.0:1788940632.994547:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 80 00000100:00100000:2.0:1788940632.994561:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b546fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:584847da-857b-4e92-a9b9-d2025c0d7e63+6:13765:x1875839718370304:12345-192.168.202.14@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788940632.995089:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b546fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:584847da-857b-4e92-a9b9-d2025c0d7e63+6:13765:x1875839718370304:12345-192.168.202.14@tcp:501:mount.lustre.0 Request processed in 528us (1141us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788940632.995099:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 80 00000100:00100000:0.0:1788940633.009345:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940633.009771:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718370432 00000100:00100000:3.0:1788940633.009786:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718370432 00000100:00100000:3.0:1788940633.009892:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 81 00000100:00100000:3.0:1788940633.009905:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b546e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:584847da-857b-4e92-a9b9-d2025c0d7e63+6:13765:x1875839718370432:12345-192.168.202.14@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788940633.009931:0:14449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940633.009954:0:14449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f1bfa96600/0x27a633fcdd4be7b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5b39 expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940633.010003:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f1bfa96600/0x27a633fcdd4be7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5b39 expref: 7 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940633.010017:0:14449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f1bfa96600/0x27a633fcdd4be7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5b39 expref: 7 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940633.010030:0:14449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f1bfa96600, rc 0) 00000100:00100000:3.0:1788940633.010155:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b546e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:584847da-857b-4e92-a9b9-d2025c0d7e63+7:13765:x1875839718370432:12345-192.168.202.14@tcp:101:mount.lustre.0 Request processed in 252us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940633.010164:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 81 00000100:00100000:1.0:1788940633.019851:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940633.019949:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718370560 00000100:00100000:2.0:1788940633.019962:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718370560 00000100:00100000:2.0:1788940633.020034:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 82 00000100:00100000:2.0:1788940633.020047:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b546c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:584847da-857b-4e92-a9b9-d2025c0d7e63+7:13765:x1875839718370560:12345-192.168.202.14@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788940633.020795:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b546c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:584847da-857b-4e92-a9b9-d2025c0d7e63+8:13765:x1875839718370560:12345-192.168.202.14@tcp:501:mount.lustre.0 Request processed in 748us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940633.020804:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 82 00000100:00100000:0.0:1788940633.026905:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940633.026963:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718370688 00000100:00100000:3.0:1788940633.026978:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718370688 00000100:00100000:3.0:1788940633.027047:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 83 00000100:00100000:3.0:1788940633.027081:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b546ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:584847da-857b-4e92-a9b9-d2025c0d7e63+8:13765:x1875839718370688:12345-192.168.202.14@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788940633.027886:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b546ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:584847da-857b-4e92-a9b9-d2025c0d7e63+8:13765:x1875839718370688:12345-192.168.202.14@tcp:503:mount.lustre.0 Request processed in 800us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940633.027899:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 83 00000100:00100000:0.0:1788940633.031388:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940633.031860:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718370816 00000100:00100000:2.0:1788940633.031902:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718370816 00000100:00100000:2.0:1788940633.031979:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 84 00000100:00100000:2.0:1788940633.031992:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b546cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:584847da-857b-4e92-a9b9-d2025c0d7e63+8:13783:x1875839718370816:12345-192.168.202.14@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788940633.032694:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b546cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:584847da-857b-4e92-a9b9-d2025c0d7e63+8:13783:x1875839718370816:12345-192.168.202.14@tcp:502:llog_process_th.0 Request processed in 701us (1318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940633.032706:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 84 00000100:00100000:1.0:1788940633.050596:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940633.050718:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718370944 00000100:00100000:3.0:1788940633.050731:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718370944 00000100:00100000:3.0:1788940633.050788:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 85 00000100:00100000:3.0:1788940633.050798:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b546d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:584847da-857b-4e92-a9b9-d2025c0d7e63+8:13783:x1875839718370944:12345-192.168.202.14@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788940633.051162:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b546d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:584847da-857b-4e92-a9b9-d2025c0d7e63+8:13783:x1875839718370944:12345-192.168.202.14@tcp:502:llog_process_th.0 Request processed in 363us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940633.051172:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 85 00000100:00100000:0.0:1788940633.058662:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940633.058810:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718371072 00000100:00100000:2.0:1788940633.058825:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718371072 00000100:00100000:2.0:1788940633.058901:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 86 00000100:00100000:2.0:1788940633.058914:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b546f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:584847da-857b-4e92-a9b9-d2025c0d7e63+8:13765:x1875839718371072:12345-192.168.202.14@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788940633.058938:0:14448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940633.058961:0:14448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f181521600/0x27a633fcdd4be82 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5b63 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940633.058999:0:14448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f181521600/0x27a633fcdd4be82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5b63 expref: 9 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940633.059012:0:14448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f181521600/0x27a633fcdd4be82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5b63 expref: 9 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940633.059023:0:14448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f181521600, rc 0) 00000100:00100000:2.0:1788940633.059099:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b546f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:584847da-857b-4e92-a9b9-d2025c0d7e63+9:13765:x1875839718371072:12345-192.168.202.14@tcp:101:mount.lustre.0 Request processed in 188us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940633.059106:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 86 00000100:00100000:0.0:1788940633.070184:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940633.079495:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718371200 00000100:00100000:1.0:1788940633.079563:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718371200 00000100:00100000:1.0:1788940633.079662:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 87 00000100:00100000:1.0:1788940633.079674:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b546c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:584847da-857b-4e92-a9b9-d2025c0d7e63+9:13765:x1875839718371200:12345-192.168.202.14@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788940633.079711:0:14446:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788940633.079742:0:14446:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788940633.079747:0:14446:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788940633.079750:0:14446:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788940633.079753:0:14446:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1788940633.084154:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b546c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:584847da-857b-4e92-a9b9-d2025c0d7e63+9:13765:x1875839718371200:12345-192.168.202.14@tcp:256:mount.lustre.0 Request processed in 4463us (13967us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940633.084177:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 87 00000100:00100000:1.0:1788940633.089507:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940633.089693:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718371328 00000100:00100000:3.0:1788940633.089707:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718371328 00000100:00100000:3.0:1788940633.089806:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 88 00000100:00100000:3.0:1788940633.089818:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b546e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:584847da-857b-4e92-a9b9-d2025c0d7e63+9:13765:x1875839718371328:12345-192.168.202.14@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788940633.089841:0:14449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940633.089862:0:14449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f1bfa97400/0x27a633fcdd4be89 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5b6a expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940633.089912:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f1bfa97400/0x27a633fcdd4be89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5b6a expref: 10 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940633.089925:0:14449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f1bfa97400/0x27a633fcdd4be89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5b6a expref: 10 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940633.089935:0:14449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f1bfa97400, rc 0) 00000100:00100000:3.0:1788940633.090027:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b546e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:584847da-857b-4e92-a9b9-d2025c0d7e63+10:13765:x1875839718371328:12345-192.168.202.14@tcp:101:mount.lustre.0 Request processed in 210us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940633.090034:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 88 00000100:00100000:3.0:1788940633.091965:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940633.092062:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718371456 00000100:00100000:0.0:1788940633.092073:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718371456 00000100:00100000:0.0:1788940633.092144:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 89 00000100:00100000:0.0:1788940633.092157:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b546f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:584847da-857b-4e92-a9b9-d2025c0d7e63+10:13765:x1875839718371456:12345-192.168.202.14@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788940633.092501:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b546f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:584847da-857b-4e92-a9b9-d2025c0d7e63+10:13765:x1875839718371456:12345-192.168.202.14@tcp:501:mount.lustre.0 Request processed in 345us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940633.092509:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 89 00000100:00100000:0.0:1788940633.095078:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940633.095372:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718371584 00000100:00100000:3.0:1788940633.095385:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718371584 00000100:00100000:3.0:1788940633.095493:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 90 00000100:00100000:3.0:1788940633.095506:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1c181f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:584847da-857b-4e92-a9b9-d2025c0d7e63+10:13765:x1875839718371584:12345-192.168.202.14@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788940633.095998:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1c181f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:584847da-857b-4e92-a9b9-d2025c0d7e63+10:13765:x1875839718371584:12345-192.168.202.14@tcp:503:mount.lustre.0 Request processed in 492us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940633.096007:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 90 00000100:00100000:1.0:1788940633.099733:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940633.099941:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718371712 00000100:00100000:2.0:1788940633.099955:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718371712 00000100:00100000:2.0:1788940633.100077:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 91 00000100:00100000:2.0:1788940633.100091:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1c181ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:584847da-857b-4e92-a9b9-d2025c0d7e63+10:13787:x1875839718371712:12345-192.168.202.14@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788940633.100504:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1c181ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:584847da-857b-4e92-a9b9-d2025c0d7e63+10:13787:x1875839718371712:12345-192.168.202.14@tcp:502:llog_process_th.0 Request processed in 414us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940633.100513:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 91 00000100:00100000:1.0:1788940633.112652:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940633.117926:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718371840 00000100:00100000:0.0:1788940633.117953:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718371840 00000100:00100000:0.0:1788940633.118052:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 92 00000100:00100000:0.0:1788940633.118064:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1c181c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:584847da-857b-4e92-a9b9-d2025c0d7e63+10:13787:x1875839718371840:12345-192.168.202.14@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788940633.118445:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1c181c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:584847da-857b-4e92-a9b9-d2025c0d7e63+10:13787:x1875839718371840:12345-192.168.202.14@tcp:502:llog_process_th.0 Request processed in 381us (5804us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940633.118454:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 92 00000100:00100000:1.0:1788940633.134707:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940633.135137:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718371968 00000100:00100000:3.0:1788940633.135153:0:14456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718371968 00000100:00100000:3.0:1788940633.135202:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 4 00000100:00100000:3.0:1788940633.135212:0:14456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1baad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2349:x1875839718371968:12345-192.168.202.14@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788940633.135252:0:14456:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from b800dac5-5ff3-48f9-949d-d7448f32aa11@192.168.202.14@tcp t0 exp 0000000000000000 cur 576 last 0 00000020:00000080:3.0:1788940633.135331:0:14456:0:(genops.c:1393:class_connect()) connect: client b800dac5-5ff3-48f9-949d-d7448f32aa11, cookie 0x27a633fcdd4be90 00000004:00100000:3.0:1788940633.135373:0:14456:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1788940633.135382:0:14456:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:1.0:1788940633.185806:0:14456:0:(import.c:65:import_set_state_nolock()) ffff89f08382c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788940633.185992:0:14456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1baad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b800dac5-5ff3-48f9-949d-d7448f32aa11+6:2349:x1875839718371968:12345-192.168.202.14@tcp:38:mount.lustre.0 Request processed in 50777us (51297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940633.186006:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 4 00000100:00100000:0.0:1788940633.188733:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940633.188859:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718372096 00000100:00100000:3.0:1788940633.188884:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718372096 00000100:00100000:3.0:1788940633.188977:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 5 00000100:00100000:3.0:1788940633.188990:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f083edc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b800dac5-5ff3-48f9-949d-d7448f32aa11+6:0:x1875839718372096:12345-192.168.202.14@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788940633.189050:0:14454:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788940633.189176:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f083edc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b800dac5-5ff3-48f9-949d-d7448f32aa11+6:0:x1875839718372096:12345-192.168.202.14@tcp:41:mount.lustre.0 Request processed in 189us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940633.189206:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 5 00000100:00080000:2.0:1788940633.189798:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788940633.191225:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940633.191337:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718372224 00000100:00100000:1.0:1788940633.191349:0:14456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718372224 00000100:00100000:1.0:1788940633.191423:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 6 00000100:00100000:1.0:1788940633.191436:0:14456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b55a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b800dac5-5ff3-48f9-949d-d7448f32aa11+6:13765:x1875839718372224:12345-192.168.202.14@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788940633.191478:0:14456:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788940633.191846:0:14456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b55a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b800dac5-5ff3-48f9-949d-d7448f32aa11+6:13765:x1875839718372224:12345-192.168.202.14@tcp:41:mount.lustre.0 Request processed in 411us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940633.191856:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 6 00000100:00100000:0.0:1788940633.194505:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940633.194730:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718372352 00000100:00100000:1.0:1788940633.194763:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718372352 00000100:00100000:1.0:1788940633.194844:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 7 00000100:00100000:1.0:1788940633.194857:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f083edf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b800dac5-5ff3-48f9-949d-d7448f32aa11+6:13765:x1875839718372352:12345-192.168.202.14@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788940633.195081:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f083edf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b800dac5-5ff3-48f9-949d-d7448f32aa11+6:13765:x1875839718372352:12345-192.168.202.14@tcp:40:mount.lustre.0 Request processed in 226us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940633.195091:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 7 00000100:00100000:0.0:1788940633.198246:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940633.198330:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940633.198370:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940633.198444:0:15139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718372480 00000100:00100000:3.0:1788940633.198457:0:15139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718372480 00000100:00100000:3.0:1788940633.198514:0:15139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718372608 00000100:00100000:3.0:1788940633.198539:0:15139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718372608 00000100:00100000:3.0:1788940633.198568:0:15139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 9 00000100:00100000:3.0:1788940633.198578:0:15139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f083edea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2349:x1875839718372480:12345-192.168.202.14@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788940633.198623:0:15139:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from b800dac5-5ff3-48f9-949d-d7448f32aa11@192.168.202.14@tcp t0 exp 0000000000000000 cur 576 last 0 00000020:00000080:3.0:1788940633.198675:0:15139:0:(genops.c:1393:class_connect()) connect: client b800dac5-5ff3-48f9-949d-d7448f32aa11, cookie 0x27a633fcdd4be97 00002000:00100000:3.0:1788940633.198691:0:15139:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b800dac5-5ff3-48f9-949d-d7448f32aa11/ffff89f083ecc800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788940633.198706:0:15139:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788940633.199165:0:15139:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788940633.199208:0:15139:0:(import.c:65:import_set_state_nolock()) ffff89f083ec8000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788940633.199295:0:15139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f083edea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b800dac5-5ff3-48f9-949d-d7448f32aa11+6:2349:x1875839718372480:12345-192.168.202.14@tcp:8:mount.lustre.0 Request processed in 716us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940633.199303:0:15139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 9 00000100:00100000:3.0:1788940633.199332:0:15139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 10 00000100:00100000:3.0:1788940633.199337:0:15139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f083edce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2349:x1875839718372608:12345-192.168.202.14@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788940633.199358:0:15139:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from b800dac5-5ff3-48f9-949d-d7448f32aa11@192.168.202.14@tcp t0 exp 0000000000000000 cur 576 last 0 00000020:00000080:3.0:1788940633.199380:0:15139:0:(genops.c:1393:class_connect()) connect: client b800dac5-5ff3-48f9-949d-d7448f32aa11, cookie 0x27a633fcdd4be9e 00002000:00100000:3.0:1788940633.199387:0:15139:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b800dac5-5ff3-48f9-949d-d7448f32aa11/ffff89f083ece800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788940633.199395:0:15139:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788940633.199648:0:15139:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788940633.199678:0:15139:0:(import.c:65:import_set_state_nolock()) ffff89f083ec8800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788940633.199703:0:15139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f083edce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b800dac5-5ff3-48f9-949d-d7448f32aa11+6:2349:x1875839718372608:12345-192.168.202.14@tcp:8:mount.lustre.0 Request processed in 364us (1332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940633.199709:0:15139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 10 00000100:00100000:0.0:1788940633.201678:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718372736 00000100:00100000:0.0:1788940633.201696:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718372736 00000100:00100000:0.0:1788940633.201801:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 0 00000100:00100000:0.0:1788940633.201811:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f083edd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b800dac5-5ff3-48f9-949d-d7448f32aa11+6:13765:x1875839718372736:12345-192.168.202.14@tcp:33:mount.lustre.0 00000004:00080000:1.0:1788940633.203696:0:14457:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1749us 00000004:00200000:1.0:1788940633.217293:0:14457:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788940633.217479:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f083edd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b800dac5-5ff3-48f9-949d-d7448f32aa11+6:13765:x1875839718372736:12345-192.168.202.14@tcp:33:mount.lustre.0 Request processed in 15660us (19240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940633.217494:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 0 00000100:00100000:0.0:1788940633.377826:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940633.378165:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718372864 00000100:00100000:2.0:1788940633.378179:0:14456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718372864 00000100:00100000:2.0:1788940633.378267:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 8 00000100:00100000:2.0:1788940633.378280:0:14456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f083ede680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b800dac5-5ff3-48f9-949d-d7448f32aa11+6:13808:x1875839718372864:12345-192.168.202.14@tcp:101:mkdir.0 00010000:00010000:2.0:1788940633.378314:0:14456:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940633.378351:0:14456:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520e00/0x27a633fcdd4bea5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5b94 expref: -99 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940633.378432:0:14456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521400/0x27a633fcdd4beac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940633.378447:0:14456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521400/0x27a633fcdd4beac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940633.378462:0:14456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521400/0x27a633fcdd4beac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940633.378504:0:14456:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788940633.378507:0:14456:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788940633.378583:0:14456:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521400/0x27a633fcdd4beac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940633.378638:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520e00/0x27a633fcdd4bea5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5b94 expref: 8 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940633.378656:0:14456:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521400/0x27a633fcdd4beac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5b94 expref: 7 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940633.378664:0:14456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f186931600) 00010000:00010000:2.0:1788940633.378667:0:14456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788940633.378670:0:14456:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f181521400, rc 0) 00000100:00100000:2.0:1788940633.378740:0:14456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f083ede680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b800dac5-5ff3-48f9-949d-d7448f32aa11+7:13808:x1875839718372864:12345-192.168.202.14@tcp:101:mkdir.0 Request processed in 463us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940633.378745:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 8 00010000:00010000:1.0:1788940633.774788:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940634.796931:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940635.664170:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940635.664492:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718372992 00000100:00100000:3.0:1788940635.664506:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718372992 00000100:00100000:3.0:1788940635.664613:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 9 00000100:00100000:3.0:1788940635.664624:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf556300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b800dac5-5ff3-48f9-949d-d7448f32aa11+7:13861:x1875839718372992:12345-192.168.202.14@tcp:41:lfs.0 00000004:00000024:3.0:1788940635.664690:0:14455:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788940635.664802:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf556300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b800dac5-5ff3-48f9-949d-d7448f32aa11+7:13861:x1875839718372992:12345-192.168.202.14@tcp:41:lfs.0 Request processed in 179us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940635.664810:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 9 00000100:00080000:3.0:1788940635.664839:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788940635.673763:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940635.673976:0:15143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718373120 00000100:00100000:2.0:1788940635.673990:0:15143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718373120 00000100:00100000:2.0:1788940635.674098:0:15143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 7 00000100:00100000:2.0:1788940635.674112:0:15143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b55a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b800dac5-5ff3-48f9-949d-d7448f32aa11+6:13861:x1875839718373120:12345-192.168.202.14@tcp:13:lfs.0 00002000:00000024:2.0:1788940635.674165:0:15143:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788940635.674274:0:15143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b55a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b800dac5-5ff3-48f9-949d-d7448f32aa11+6:13861:x1875839718373120:12345-192.168.202.14@tcp:13:lfs.0 Request processed in 165us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940635.674283:0:15143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 7 00000100:00080000:3.0:1788940635.675026:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788940635.694938:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940635.696103:0:15142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718373248 00000100:00100000:3.0:1788940635.696120:0:15142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718373248 00000100:00100000:3.0:1788940635.696215:0:15142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 8 00000100:00100000:3.0:1788940635.696228:0:15142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1baad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b800dac5-5ff3-48f9-949d-d7448f32aa11+6:13861:x1875839718373248:12345-192.168.202.14@tcp:13:lfs.0 00002000:00000024:3.0:1788940635.696278:0:15142:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788940635.696390:0:15142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1baad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b800dac5-5ff3-48f9-949d-d7448f32aa11+6:13861:x1875839718373248:12345-192.168.202.14@tcp:13:lfs.0 Request processed in 164us (1467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940635.696398:0:15142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 8 00000100:00080000:1.0:1788940635.703993:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:3.0:1788940635.722835:0:6732:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b800dac5-5ff3-48f9-949d-d7448f32aa11 00010000:00010000:1.0:1788940635.820885:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940636.053626:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940636.053815:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718373376 00000100:00100000:0.0:1788940636.053833:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718373376 00000100:00100000:0.0:1788940636.053926:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 93 00000100:00100000:0.0:1788940636.053939:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1c181e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:584847da-857b-4e92-a9b9-d2025c0d7e63+10:13894:x1875839718373376:12345-192.168.202.14@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788940636.053967:0:14446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940636.053992:0:14446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f0812ea400/0x27a633fcdd4beb3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5b9b expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940636.054030:0:14446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f0812ea400/0x27a633fcdd4beb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5b9b expref: 11 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940636.054045:0:14446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f0812ea400/0x27a633fcdd4beb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5b9b expref: 11 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940636.054098:0:14446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f0812ea400, rc 0) 00000100:00100000:0.0:1788940636.055419:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1c181e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:584847da-857b-4e92-a9b9-d2025c0d7e63+11:13894:x1875839718373376:12345-192.168.202.14@tcp:101:mount.lustre.0 Request processed in 1472us (1800us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940636.055433:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 93 00000100:00100000:3.0:1788940636.078300:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940636.078568:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718373504 00000100:00100000:2.0:1788940636.078582:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718373504 00000100:00100000:2.0:1788940636.078658:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 94 00000100:00100000:2.0:1788940636.078671:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1c181c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:584847da-857b-4e92-a9b9-d2025c0d7e63+11:13894:x1875839718373504:12345-192.168.202.14@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788940636.079279:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1c181c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:584847da-857b-4e92-a9b9-d2025c0d7e63+11:13894:x1875839718373504:12345-192.168.202.14@tcp:501:mount.lustre.0 Request processed in 607us (992us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940636.079289:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 94 00000100:00100000:1.0:1788940636.097921:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940636.098312:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718373632 00000100:00100000:0.0:1788940636.098326:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718373632 00000100:00100000:0.0:1788940636.098400:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 95 00000100:00100000:0.0:1788940636.098411:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1c181dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:584847da-857b-4e92-a9b9-d2025c0d7e63+11:13894:x1875839718373632:12345-192.168.202.14@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788940636.098785:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1c181dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:584847da-857b-4e92-a9b9-d2025c0d7e63+11:13894:x1875839718373632:12345-192.168.202.14@tcp:503:mount.lustre.0 Request processed in 374us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940636.098794:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 95 00000100:00100000:0.0:1788940636.105924:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940636.106577:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718373760 00000100:00100000:3.0:1788940636.106593:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718373760 00000100:00100000:3.0:1788940636.106684:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 96 00000100:00100000:3.0:1788940636.106696:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1c181e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:584847da-857b-4e92-a9b9-d2025c0d7e63+11:13900:x1875839718373760:12345-192.168.202.14@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788940636.107312:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1c181e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:584847da-857b-4e92-a9b9-d2025c0d7e63+11:13900:x1875839718373760:12345-192.168.202.14@tcp:502:llog_process_th.0 Request processed in 615us (1400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940636.107321:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 96 00000100:00100000:0.0:1788940636.130491:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940636.130645:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718373888 00000100:00100000:2.0:1788940636.130660:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718373888 00000100:00100000:2.0:1788940636.130724:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 97 00000100:00100000:2.0:1788940636.130735:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1c181e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:584847da-857b-4e92-a9b9-d2025c0d7e63+11:13900:x1875839718373888:12345-192.168.202.14@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788940636.131145:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1c181e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:584847da-857b-4e92-a9b9-d2025c0d7e63+11:13900:x1875839718373888:12345-192.168.202.14@tcp:502:llog_process_th.0 Request processed in 410us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940636.131154:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 97 00000100:00100000:1.0:1788940636.151380:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940636.151739:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718374016 00000100:00100000:0.0:1788940636.151754:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718374016 00000100:00100000:0.0:1788940636.151826:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 98 00000100:00100000:0.0:1788940636.151837:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1c181fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:584847da-857b-4e92-a9b9-d2025c0d7e63+11:13894:x1875839718374016:12345-192.168.202.14@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788940636.151868:0:14446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940636.151890:0:14446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f0812eac00/0x27a633fcdd4beba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5bc5 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940636.151926:0:14446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f0812eac00/0x27a633fcdd4beba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5bc5 expref: 12 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940636.151939:0:14446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f0812eac00/0x27a633fcdd4beba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5bc5 expref: 12 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940636.151967:0:14446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f0812eac00, rc 0) 00000100:00100000:0.0:1788940636.152045:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1c181fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:584847da-857b-4e92-a9b9-d2025c0d7e63+12:13894:x1875839718374016:12345-192.168.202.14@tcp:101:mount.lustre.0 Request processed in 209us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940636.152053:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 98 00000100:00100000:0.0:1788940636.155817:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940636.155956:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718374144 00000100:00100000:3.0:1788940636.155969:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718374144 00000100:00100000:3.0:1788940636.156039:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 99 00000100:00100000:3.0:1788940636.156052:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1c181d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:584847da-857b-4e92-a9b9-d2025c0d7e63+12:13894:x1875839718374144:12345-192.168.202.14@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788940636.156101:0:14448:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788940636.156133:0:14448:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788940636.156138:0:14448:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788940636.156141:0:14448:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788940636.156144:0:14448:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1788940636.161404:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1c181d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:584847da-857b-4e92-a9b9-d2025c0d7e63+12:13894:x1875839718374144:12345-192.168.202.14@tcp:256:mount.lustre.0 Request processed in 5337us (5583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940636.161424:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 99 00000100:00100000:1.0:1788940636.172459:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940636.172736:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718374272 00000100:00100000:3.0:1788940636.172750:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718374272 00000100:00100000:3.0:1788940636.172818:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 100 00000100:00100000:3.0:1788940636.172831:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1c181cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:584847da-857b-4e92-a9b9-d2025c0d7e63+12:13894:x1875839718374272:12345-192.168.202.14@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788940636.172962:0:14449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940636.172987:0:14449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f1bfa97800/0x27a633fcdd4bec1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5bcc expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940636.173026:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f1bfa97800/0x27a633fcdd4bec1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5bcc expref: 13 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940636.173148:0:14449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f1bfa97800/0x27a633fcdd4bec1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5bcc expref: 13 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940636.173161:0:14449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f1bfa97800, rc 0) 00000100:00100000:3.0:1788940636.173272:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1c181cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:584847da-857b-4e92-a9b9-d2025c0d7e63+13:13894:x1875839718374272:12345-192.168.202.14@tcp:101:mount.lustre.0 Request processed in 443us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940636.173280:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 100 00000100:00100000:0.0:1788940636.186018:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940636.186323:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718374400 00000100:00100000:3.0:1788940636.186338:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718374400 00000100:00100000:3.0:1788940636.186408:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 101 00000100:00100000:3.0:1788940636.186419:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1c181d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:584847da-857b-4e92-a9b9-d2025c0d7e63+13:13894:x1875839718374400:12345-192.168.202.14@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788940636.186799:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1c181d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:584847da-857b-4e92-a9b9-d2025c0d7e63+13:13894:x1875839718374400:12345-192.168.202.14@tcp:501:mount.lustre.0 Request processed in 380us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940636.186807:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 101 00000100:00100000:1.0:1788940636.193965:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940636.194267:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718374528 00000100:00100000:3.0:1788940636.194282:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718374528 00000100:00100000:3.0:1788940636.194366:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 102 00000100:00100000:3.0:1788940636.194380:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1c181f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:584847da-857b-4e92-a9b9-d2025c0d7e63+13:13894:x1875839718374528:12345-192.168.202.14@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788940636.194738:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1c181f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:584847da-857b-4e92-a9b9-d2025c0d7e63+13:13894:x1875839718374528:12345-192.168.202.14@tcp:503:mount.lustre.0 Request processed in 359us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940636.194747:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 102 00000100:00100000:1.0:1788940636.205881:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940636.206203:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718374656 00000100:00100000:0.0:1788940636.206218:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718374656 00000100:00100000:0.0:1788940636.206290:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 103 00000100:00100000:0.0:1788940636.206303:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1c181f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:584847da-857b-4e92-a9b9-d2025c0d7e63+13:13902:x1875839718374656:12345-192.168.202.14@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788940636.206697:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1c181f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:584847da-857b-4e92-a9b9-d2025c0d7e63+13:13902:x1875839718374656:12345-192.168.202.14@tcp:502:llog_process_th.0 Request processed in 395us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940636.206707:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 103 00000100:00100000:0.0:1788940636.238972:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940636.243652:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718374784 00000100:00100000:2.0:1788940636.243674:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718374784 00000100:00100000:2.0:1788940636.243766:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 104 00000100:00100000:2.0:1788940636.243778:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1af527450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:584847da-857b-4e92-a9b9-d2025c0d7e63+13:13902:x1875839718374784:12345-192.168.202.14@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788940636.244143:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1af527450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:584847da-857b-4e92-a9b9-d2025c0d7e63+13:13902:x1875839718374784:12345-192.168.202.14@tcp:502:llog_process_th.0 Request processed in 366us (5185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940636.244153:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 104 00000100:00100000:1.0:1788940636.262067:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940636.262795:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718374912 00000100:00100000:3.0:1788940636.262813:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718374912 00000100:00100000:3.0:1788940636.262888:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 10 00000100:00100000:3.0:1788940636.262900:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1baad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2349:x1875839718374912:12345-192.168.202.14@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788940636.262963:0:14454:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 36f240b4-a296-44d9-a5c6-bed8adad0c38@192.168.202.14@tcp t0 exp 0000000000000000 cur 579 last 0 00000020:00000080:3.0:1788940636.263026:0:14454:0:(genops.c:1393:class_connect()) connect: client 36f240b4-a296-44d9-a5c6-bed8adad0c38, cookie 0x27a633fcdd4bec8 00000004:00100000:3.0:1788940636.263068:0:14454:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788940636.263254:0:14454:0:(import.c:65:import_set_state_nolock()) ffff89f083ec9800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788940636.263355:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1baad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36f240b4-a296-44d9-a5c6-bed8adad0c38+6:2349:x1875839718374912:12345-192.168.202.14@tcp:38:mount.lustre.0 Request processed in 455us (1302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940636.263365:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 10 00000100:00100000:3.0:1788940636.281386:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940636.286586:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940636.298182:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718375168 00000100:00100000:2.0:1788940636.298206:0:14456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718375168 00000100:00100000:2.0:1788940636.298325:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718375040 00000100:00100000:2.0:1788940636.298328:0:14456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718375040 00000100:00100000:2.0:1788940636.298354:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 11 00000100:00100000:2.0:1788940636.298366:0:14456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b55a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36f240b4-a296-44d9-a5c6-bed8adad0c38+7:13894:x1875839718375168:12345-192.168.202.14@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788940636.298427:0:14456:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788940636.298808:0:14456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b55a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36f240b4-a296-44d9-a5c6-bed8adad0c38+7:13894:x1875839718375168:12345-192.168.202.14@tcp:41:mount.lustre.0 Request processed in 442us (17438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940636.298837:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 11 00000100:00100000:2.0:1788940636.298923:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 12 00000100:00100000:2.0:1788940636.298932:0:14456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1baad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36f240b4-a296-44d9-a5c6-bed8adad0c38+6:0:x1875839718375040:12345-192.168.202.14@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788940636.298944:0:14456:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788940636.298966:0:14456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1baad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36f240b4-a296-44d9-a5c6-bed8adad0c38+6:0:x1875839718375040:12345-192.168.202.14@tcp:41:mount.lustre.0 Request processed in 36us (12397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940636.298973:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 12 00000100:00080000:1.0:1788940636.299741:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788940636.302382:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940636.302736:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718375296 00000100:00100000:0.0:1788940636.302749:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718375296 00000100:00100000:0.0:1788940636.302821:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 13 00000100:00100000:0.0:1788940636.302833:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b55ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36f240b4-a296-44d9-a5c6-bed8adad0c38+6:13894:x1875839718375296:12345-192.168.202.14@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788940636.302957:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b55ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36f240b4-a296-44d9-a5c6-bed8adad0c38+6:13894:x1875839718375296:12345-192.168.202.14@tcp:40:mount.lustre.0 Request processed in 125us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940636.302966:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 13 00000100:00100000:0.0:1788940636.306390:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940636.306435:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940636.306584:0:15140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718375424 00000100:00100000:2.0:1788940636.306596:0:15140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718375424 00000100:00100000:2.0:1788940636.306793:0:15140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718375552 00000100:00100000:2.0:1788940636.306798:0:15140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718375552 00000100:00100000:1.0:1788940636.308208:0:15141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 11 00000100:00100000:1.0:1788940636.308221:0:15141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f083eded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2349:x1875839718375424:12345-192.168.202.14@tcp:8:mount.lustre.0 00000100:00100000:1.0:1788940636.309126:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940636.309245:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718375680 00000100:00100000:3.0:1788940636.309254:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718375680 00000100:00100000:3.0:1788940636.309307:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 1 00000100:00100000:3.0:1788940636.309316:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1baad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36f240b4-a296-44d9-a5c6-bed8adad0c38+6:13894:x1875839718375680:12345-192.168.202.14@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788940636.309407:0:14458:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788940636.309537:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1baad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36f240b4-a296-44d9-a5c6-bed8adad0c38+6:13894:x1875839718375680:12345-192.168.202.14@tcp:33:mount.lustre.0 Request processed in 200us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940636.309546:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 1 00010000:00080000:0.0:1788940636.313402:0:15141:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 36f240b4-a296-44d9-a5c6-bed8adad0c38@192.168.202.14@tcp t0 exp 0000000000000000 cur 579 last 0 00000020:00000080:0.0:1788940636.313493:0:15141:0:(genops.c:1393:class_connect()) connect: client 36f240b4-a296-44d9-a5c6-bed8adad0c38, cookie 0x27a633fcdd4becf 00002000:00100000:0.0:1788940636.313512:0:15141:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 36f240b4-a296-44d9-a5c6-bed8adad0c38/ffff89f1befb2000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788940636.313550:0:15141:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788940636.314107:0:15141:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788940636.314160:0:15141:0:(import.c:65:import_set_state_nolock()) ffff89f1befb7800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788940636.314325:0:15141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f083eded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36f240b4-a296-44d9-a5c6-bed8adad0c38+6:2349:x1875839718375424:12345-192.168.202.14@tcp:8:mount.lustre.0 Request processed in 6102us (7948us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940636.314338:0:15141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 11 00000100:00100000:0.0:1788940636.314381:0:15141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 12 00000100:00100000:0.0:1788940636.314389:0:15141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f083edfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2349:x1875839718375552:12345-192.168.202.14@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788940636.314418:0:15141:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 36f240b4-a296-44d9-a5c6-bed8adad0c38@192.168.202.14@tcp t0 exp 0000000000000000 cur 579 last 0 00000020:00000080:0.0:1788940636.314440:0:15141:0:(genops.c:1393:class_connect()) connect: client 36f240b4-a296-44d9-a5c6-bed8adad0c38, cookie 0x27a633fcdd4bed6 00002000:00100000:0.0:1788940636.314448:0:15141:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 36f240b4-a296-44d9-a5c6-bed8adad0c38/ffff89f1befb5800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788940636.314457:0:15141:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788940636.315766:0:15141:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788940636.315811:0:15141:0:(import.c:65:import_set_state_nolock()) ffff89f1befb3800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788940636.315890:0:15141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f083edfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36f240b4-a296-44d9-a5c6-bed8adad0c38+6:2349:x1875839718375552:12345-192.168.202.14@tcp:8:mount.lustre.0 Request processed in 1499us (9453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940636.315902:0:15141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 12 00000100:00100000:1.0:1788940636.518469:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940636.518641:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718375808 00000100:00100000:3.0:1788940636.518656:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718375808 00000100:00100000:3.0:1788940636.518738:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 14 00000100:00100000:3.0:1788940636.518750:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1baad5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36f240b4-a296-44d9-a5c6-bed8adad0c38+6:13923:x1875839718375808:12345-192.168.202.14@tcp:101:mkdir.0 00010000:00010000:3.0:1788940636.518781:0:14454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940636.518815:0:14454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96e00/0x27a633fcdd4bedd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5bf6 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940636.518900:0:14454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97000/0x27a633fcdd4bee4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940636.518935:0:14454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97000/0x27a633fcdd4bee4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940636.518952:0:14454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97000/0x27a633fcdd4bee4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940636.519000:0:14454:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788940636.519004:0:14454:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788940636.519031:0:14454:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97000/0x27a633fcdd4bee4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940636.519063:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96e00/0x27a633fcdd4bedd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5bf6 expref: 8 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940636.519118:0:14454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97000/0x27a633fcdd4bee4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5bf6 expref: 7 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940636.519127:0:14454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f186931600) 00010000:00010000:3.0:1788940636.519130:0:14454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788940636.519134:0:14454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f1bfa97000, rc 0) 00000100:00100000:3.0:1788940636.519223:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1baad5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36f240b4-a296-44d9-a5c6-bed8adad0c38+7:13923:x1875839718375808:12345-192.168.202.14@tcp:101:mkdir.0 Request processed in 474us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940636.519231:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 14 00010000:00010000:1.0:1788940636.844980:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940637.685858:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf557480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3305:1875839738295168:0@lo:400:kworker.0 00000100:00100000:2.0:1788940637.685953:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940637.686010:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf554380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875839738295680:0@lo:400:kworker.0 00000100:00100000:2.0:1788940637.686039:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940637.686080:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788940637.686087:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf554a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738295296:0@lo:400:kworker.0 00000100:00100000:2.0:1788940637.686117:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940637.686136:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf554e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875839738295808:0@lo:400:kworker.0 00000100:00100000:2.0:1788940637.686157:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940637.686186:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf554700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738295424:0@lo:400:kworker.0 00000100:00100000:2.0:1788940637.686210:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940637.686228:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf554000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738295936:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788940637.686251:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940637.686283:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788940637.686289:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf555500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875839738295552:0@lo:400:kworker.0 00000100:00100000:2.0:1788940637.686312:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940637.686347:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738295680 00000100:00100000:2.0:1788940637.686357:0:14456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738295680 00000100:00100000:2.0:1788940637.686412:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738295808 00000100:00100000:2.0:1788940637.686415:0:14456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738295808 00000100:00100000:2.0:1788940637.686431:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738295552 00000100:00100000:2.0:1788940637.686433:0:14456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738295552 00000100:00100000:2.0:1788940637.686448:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788940637.686457:0:14456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf557100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875839738295680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940637.686552:0:14456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf557100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875839738295680:12345-0@lo:400:kworker.0 Request processed in 96us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940637.686561:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788940637.686581:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788940637.686587:0:14456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf556a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875839738295808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940637.686614:0:14456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf556a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875839738295808:12345-0@lo:400:kworker.0 Request processed in 28us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940637.686620:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788940637.686631:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788940637.686636:0:14456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf555880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875839738295552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940637.686664:0:14456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf555880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875839738295552:12345-0@lo:400:kworker.0 Request processed in 28us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940637.686670:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788940637.686687:0:15139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738295296 00000100:00100000:2.0:1788940637.686690:0:15139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738295296 00000100:00100000:2.0:1788940637.686716:0:15139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738295424 00000100:00100000:2.0:1788940637.686719:0:15139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738295424 00000100:00100000:2.0:1788940637.686743:0:15139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788940637.686749:0:15139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf555c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738295296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940637.686781:0:15139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf555c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738295296:12345-0@lo:400:kworker.0 Request processed in 32us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940637.686787:0:15139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788940637.686798:0:15139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788940637.686804:0:15139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf556d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738295424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940637.686830:0:15139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf556d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738295424:12345-0@lo:400:kworker.0 Request processed in 26us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940637.686835:0:15139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788940637.686860:0:16302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738295936 00000100:00100000:2.0:1788940637.686864:0:16302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738295936 00000100:00100000:2.0:1788940637.686888:0:16302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788940637.686895:0:16302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf555f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738295936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788940637.686927:0:16302:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788940637.686959:0:16302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf555f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738295936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940637.686965:0:16302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1788940637.686986:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788940637.686990:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788940637.686993:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940637.687027:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf554a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738295296:0@lo:400:kworker.0 00000100:00100000:2.0:1788940637.687042:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf554e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875839738295808:0@lo:400:kworker.0 00000100:00100000:2.0:1788940637.687053:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf554380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875839738295680:0@lo:400:kworker.0 00000100:00100000:2.0:1788940637.687103:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf555500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875839738295552:0@lo:400:kworker.0 00000100:00100000:2.0:1788940637.687124:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1788940637.687137:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf554700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738295424:0@lo:400:kworker.0 00000100:00100000:2.0:1788940637.687151:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf554000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738295936:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788940637.690792:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf554000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738296064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788940637.690957:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940637.691031:0:15143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738296064 00000100:00100000:2.0:1788940637.691041:0:15143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738296064 00000100:00100000:2.0:1788940637.691109:0:15143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788940637.691120:0:15143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf554700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738296064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788940637.691163:0:15143:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788940637.691211:0:15143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf554700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738296064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940637.691218:0:15143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788940637.691275:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf554000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738296064:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788940637.693310:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738295168 00000100:00100000:3.0:1788940637.693328:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738295168 00000100:00100000:3.0:1788940637.693376:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788940637.693384:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1af526850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+19:3305:x1875839738295168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940637.693493:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1af526850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+19:3305:x1875839738295168:12345-0@lo:400:kworker.0 Request processed in 109us (7540us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940637.693511:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788940637.694889:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf557480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3305:1875839738295168:0@lo:400:kworker.0 00000001:00100000:0.0:1788940637.790989:0:7662:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 36f240b4-a296-44d9-a5c6-bed8adad0c38 00000001:00100000:0.0:1788940637.791012:0:7662:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b800dac5-5ff3-48f9-949d-d7448f32aa11 00010000:00010000:1.0:1788940637.870842:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788940638.324369:0:5883:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b800dac5-5ff3-48f9-949d-d7448f32aa11 00000001:00100000:1.0:1788940638.324400:0:5883:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 36f240b4-a296-44d9-a5c6-bed8adad0c38 00010000:00010000:1.0:1788940638.895198:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788940639.729485:0:14488:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788940639.916882:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788940640.226427:0:16423:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:2.0:1788940640.813224:0:6732:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 36f240b4-a296-44d9-a5c6-bed8adad0c38 00010000:00010000:1.0:1788940640.941013:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940641.788492:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940641.788604:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940641.788632:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940641.788669:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940641.788692:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940641.788711:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940641.788735:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940641.788842:0:15139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718376192 00000100:00100000:2.0:1788940641.788856:0:15139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718376192 00000100:00100000:2.0:1788940641.788932:0:15139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718376704 00000100:00100000:2.0:1788940641.788936:0:15139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718376704 00000100:00100000:2.0:1788940641.788955:0:15139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718376320 00000100:00100000:2.0:1788940641.788957:0:15139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718376320 00000100:00100000:2.0:1788940641.788971:0:15139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718376576 00000100:00100000:2.0:1788940641.788973:0:15139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718376576 00000100:00100000:2.0:1788940641.789015:0:15139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 6 00000100:00100000:2.0:1788940641.789026:0:15139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1baad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b800dac5-5ff3-48f9-949d-d7448f32aa11+5:2352:x1875839718376192:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788940641.789137:0:15139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1baad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b800dac5-5ff3-48f9-949d-d7448f32aa11+5:2352:x1875839718376192:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 112us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940641.789452:0:15139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 6 00000100:00100000:2.0:1788940641.789475:0:15139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 7 00000100:00100000:2.0:1788940641.789484:0:15139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1baad5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36f240b4-a296-44d9-a5c6-bed8adad0c38+5:2352:x1875839718376704:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788940641.789549:0:15139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1baad5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36f240b4-a296-44d9-a5c6-bed8adad0c38+5:2352:x1875839718376704:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 35us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940641.789557:0:15139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 7 00000100:00100000:2.0:1788940641.789571:0:15139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 8 00000100:00100000:2.0:1788940641.789578:0:15139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4c24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b800dac5-5ff3-48f9-949d-d7448f32aa11+5:2352:x1875839718376320:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788940641.789605:0:15139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4c24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b800dac5-5ff3-48f9-949d-d7448f32aa11+5:2352:x1875839718376320:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 28us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940641.789612:0:15139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 8 00000100:00100000:2.0:1788940641.789624:0:15139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 9 00000100:00100000:2.0:1788940641.789631:0:15139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4c26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36f240b4-a296-44d9-a5c6-bed8adad0c38+5:2352:x1875839718376576:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788940641.789655:0:15139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4c26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36f240b4-a296-44d9-a5c6-bed8adad0c38+5:2352:x1875839718376576:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 25us (919us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940641.789661:0:15139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 9 00000100:00100000:2.0:1788940641.789690:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718376448 00000100:00100000:2.0:1788940641.789695:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718376448 00000100:00100000:2.0:1788940641.789728:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718376064 00000100:00100000:2.0:1788940641.789731:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718376064 00000100:00100000:2.0:1788940641.789759:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 20 00000100:00100000:2.0:1788940641.789764:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1baad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36f240b4-a296-44d9-a5c6-bed8adad0c38+6:2352:x1875839718376448:12345-192.168.202.14@tcp:400:kworker.0 00000100:00080000:1.0:1788940641.789874:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788940641.789881:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788940641.789883:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788940641.790456:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718375936 00000100:00100000:0.0:1788940641.790464:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718375936 00000100:00100000:0.0:1788940641.790550:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 106 00000100:00100000:0.0:1788940641.790560:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1af526c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:584847da-857b-4e92-a9b9-d2025c0d7e63+13:2352:x1875839718375936:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788940641.790714:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1baad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36f240b4-a296-44d9-a5c6-bed8adad0c38+6:2352:x1875839718376448:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 946us (2078us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940641.790722:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 20 00000100:00100000:2.0:1788940641.790740:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 21 00000100:00100000:2.0:1788940641.790748:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4c27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b800dac5-5ff3-48f9-949d-d7448f32aa11+6:2352:x1875839718376064:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788940641.792773:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1af526c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:584847da-857b-4e92-a9b9-d2025c0d7e63+13:2352:x1875839718375936:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 2196us (4288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940641.792791:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 106 00000100:00100000:2.0:1788940641.792909:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4c27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b800dac5-5ff3-48f9-949d-d7448f32aa11+6:2352:x1875839718376064:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 2159us (4212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940641.792920:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 21 00010000:00010000:1.0:1788940641.969905:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940642.797510:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf557480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738296192:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788940642.797623:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940642.797722:0:15142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738296192 00000100:00100000:2.0:1788940642.797733:0:15142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738296192 00000100:00100000:2.0:1788940642.797815:0:15142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788940642.797826:0:15142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf554000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738296192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788940642.797880:0:15142:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788940642.797936:0:15142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf554000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738296192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940642.797943:0:15142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1788940642.797972:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788940642.798046:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf557480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738296192:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788940642.798492:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b55abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3307:1875839738296448:0@lo:400:kworker.0 00000100:00100000:3.0:1788940642.798565:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940642.798597:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b55a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875839738296960:0@lo:400:kworker.0 00000100:00100000:3.0:1788940642.798625:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940642.798649:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788940642.798655:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b55a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738296576:0@lo:400:kworker.0 00000100:00100000:3.0:1788940642.798689:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940642.798727:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738296448 00000100:00100000:3.0:1788940642.798733:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738296448 00000100:00100000:3.0:1788940642.798791:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788940642.798805:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1af527050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+19:3307:x1875839738296448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940642.798845:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1af527050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+19:3307:x1875839738296448:12345-0@lo:400:kworker.0 Request processed in 43us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940642.798851:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788940642.798884:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738296960 00000100:00100000:3.0:1788940642.798888:0:14456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738296960 00000100:00100000:3.0:1788940642.798919:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788940642.798925:0:14456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b55a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875839738296960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940642.798952:0:14456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b55a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875839738296960:12345-0@lo:400:kworker.0 Request processed in 28us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940642.798958:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788940642.798973:0:15139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738296576 00000100:00100000:3.0:1788940642.798976:0:15139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738296576 00000100:00100000:3.0:1788940642.799000:0:15139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788940642.799006:0:15139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b55aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738296576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940642.799104:0:15139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b55aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738296576:12345-0@lo:400:kworker.0 Request processed in 98us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940642.799111:0:15139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1788940642.799142:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788940642.799147:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788940642.799172:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b55a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738296576:0@lo:400:kworker.0 00000100:00100000:3.0:1788940642.799184:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b55abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3307:1875839738296448:0@lo:400:kworker.0 00000100:00100000:3.0:1788940642.799193:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b55a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875839738296960:0@lo:400:kworker.0 00000100:00100000:3.0:1788940642.799224:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b55a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875839738296704:0@lo:400:kworker.0 00000100:00100000:3.0:1788940642.799250:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940642.799270:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788940642.799274:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b55ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738296320:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788940642.799292:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940642.799303:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b55a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875839738296832:0@lo:400:kworker.0 00000100:00100000:3.0:1788940642.799317:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940642.799333:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738296704 00000100:00100000:3.0:1788940642.799336:0:14456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738296704 00000100:00100000:3.0:1788940642.799352:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738296832 00000100:00100000:3.0:1788940642.799355:0:14456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738296832 00000100:00100000:3.0:1788940642.799369:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788940642.799374:0:14456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b55a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875839738296704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940642.799407:0:14456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b55a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875839738296704:12345-0@lo:400:kworker.0 Request processed in 33us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940642.799413:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788940642.799425:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788940642.799438:0:14456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b55a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875839738296832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940642.799467:0:14456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b55a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875839738296832:12345-0@lo:400:kworker.0 Request processed in 30us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940642.799473:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1788940642.799489:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788940642.799506:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b55a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875839738296832:0@lo:400:kworker.0 00000100:00100000:3.0:1788940642.799549:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b55a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875839738296704:0@lo:400:kworker.0 00000100:00100000:2.0:1788940642.803393:0:16302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738296320 00000100:00100000:2.0:1788940642.803415:0:16302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738296320 00000100:00100000:2.0:1788940642.803503:0:16302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788940642.803545:0:16302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b55abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738296320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788940642.803609:0:16302:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788940642.803759:0:16302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b55abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738296320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 219us (4464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940642.803768:0:16302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788940642.803938:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b55ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738296320:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788940642.993653:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940644.014061:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788940644.319354:0:16573:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe97fdc680 20000000:00000080:0.0:1788940644.319384:0:16573:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff89f081290000 uarg=0000000000000000 20000000:01000000:0.0:1788940644.319443:0:16573:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788940644.319451:0:16573:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788940644.319469:0:16573:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788940644.322872:0:16574:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1788940644.323142:0:16573:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788940644.333721:0:16573:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788940644.333765:0:16573:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89f0812eb000/0x27a633fcdd4beeb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940644.333794:0:16573:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89f19258c800/0x27a633fcdd4bbe2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4bbdb expref: 18 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940644.333802:0:16573:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89f1bfa96200/0x27a633fcdd4bc2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4bc28 expref: 18 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940644.333808:0:16573:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89f19258c400/0x27a633fcdd4bd63 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4bd5c expref: 18 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940644.333819:0:16573:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89f1bfa97400/0x27a633fcdd4be89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5b6a expref: 12 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940644.333827:0:16573:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89f1bfa97800/0x27a633fcdd4bec1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5bcc expref: 12 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940644.333836:0:16573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89f0812eb000/0x27a633fcdd4beeb lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940644.333933:0:16573:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89f1bfa97800/0x27a633fcdd4bec1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5bcc expref: 12 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940644.333952:0:16573:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89f1bfa97800/0x27a633fcdd4bec1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5bcc expref: 12 pid: 14449 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940644.333971:0:16573:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f083ede300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16573:1875839738297088:192.168.202.14@tcp:104: 00010000:00010000:0.0:1788940644.334142:0:16573:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89f1bfa97400/0x27a633fcdd4be89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5b6a expref: 12 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940644.334151:0:16573:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89f1bfa97400/0x27a633fcdd4be89 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5b6a expref: 12 pid: 14449 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940644.334161:0:16573:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f083edf800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16573:1875839738297216:192.168.202.14@tcp:104: 00010000:00010000:0.0:1788940644.334186:0:16573:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89f19258c400/0x27a633fcdd4bd63 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27a633fcdd4bd5c expref: 18 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940644.334195:0:16573:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89f19258c400/0x27a633fcdd4bd63 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27a633fcdd4bd5c expref: 18 pid: 14449 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940644.334204:0:16573:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f083edd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16573:1875839738297344:0@lo:104: 00000100:00100000:0.0:1788940644.334248:0:16573:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788940644.334288:0:16573:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89f1bfa96200/0x27a633fcdd4bc2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27a633fcdd4bc28 expref: 18 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940644.334296:0:16573:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89f1bfa96200/0x27a633fcdd4bc2f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27a633fcdd4bc28 expref: 18 pid: 14449 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940644.334316:0:16573:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bfbedc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16573:1875839738297472:0@lo:104: 00000100:00100000:0.0:1788940644.334336:0:16573:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788940644.334357:0:16573:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89f19258c800/0x27a633fcdd4bbe2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27a633fcdd4bbdb expref: 18 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940644.334365:0:16573:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89f19258c800/0x27a633fcdd4bbe2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27a633fcdd4bbdb expref: 18 pid: 14449 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940644.334373:0:16573:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bfbeed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16573:1875839738297600:0@lo:104: 00000100:00100000:0.0:1788940644.334395:0:16573:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940644.334404:0:16573:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f195e87180 going to sleep for 11 seconds 00000100:00100000:3.0:1788940644.335088:0:14437:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788940644.335110:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738297344 00000100:00100000:3.0:1788940644.335119:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738297344 00000100:00100000:3.0:1788940644.335168:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738297472 00000100:00100000:3.0:1788940644.335171:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738297472 00000100:00100000:3.0:1788940644.335179:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738297600 00000100:00100000:3.0:1788940644.335181:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738297600 00000100:00100000:3.0:1788940644.335193:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788940644.335203:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbeea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+5:16573:x1875839738297344:12345-0@lo:104: 00010000:00010000:3.0:1788940644.335219:0:14437:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff89f1bfa96800/0x27a633fcdd4bd5c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4bd63 expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.335292:0:14437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788940644.335298:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbeea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+5:16573:x1875839738297344:12345-0@lo:104: Request processed in 97us (1050us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940644.335305:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788940644.335327:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788940644.335332:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+4:16573:x1875839738297472:12345-0@lo:104: 00010000:00010000:3.0:1788940644.335340:0:14437:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff89f188daba00/0x27a633fcdd4bc28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4bc2f expref: -99 pid: 15137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.335381:0:14437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788940644.335386:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+4:16573:x1875839738297472:12345-0@lo:104: Request processed in 55us (1050us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940644.335392:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788940644.335402:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788940644.335407:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c39c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+3:16573:x1875839738297600:12345-0@lo:104: 00010000:00010000:3.0:1788940644.335414:0:14437:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff89f188daa000/0x27a633fcdd4bbdb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4bbe2 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.335434:0:14437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788940644.335439:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c39c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+3:16573:x1875839738297600:12345-0@lo:104: Request processed in 32us (1043us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940644.335444:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1788940644.335491:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788940644.335497:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff89f1bfa96800/0x27a633fcdd4bd5c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4bd63 expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.335505:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1bfa96800 already unused, calling callback (ffffffffc1d10c20) 10000000:00010000:3.0:1788940644.335509:0:14443:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff89f1bfa96800/0x27a633fcdd4bd5c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x27a633fcdd4bd63 expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.335535:0:14443:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff89f1bfa96800/0x27a633fcdd4bd5c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x27a633fcdd4bd63 expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788940644.335543:0:14443:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff89f1bfa96800/0x27a633fcdd4bd5c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x27a633fcdd4bd63 expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940644.335550:0:14443:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788940644.335595:0:14443:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff89f1bfa96800/0x27a633fcdd4bd5c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4bd63 expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.335602:0:14443:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788940644.335637:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff89f1bfa96800/0x27a633fcdd4bd5c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4bd63 expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.335645:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff89f1bfa96800/0x27a633fcdd4bd5c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4bd63 expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.335660:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788940644.335664:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff89f188daba00/0x27a633fcdd4bc28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4bc2f expref: -99 pid: 15137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.335669:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188daba00 already unused, calling callback (ffffffffc1d10c20) 10000000:00010000:3.0:1788940644.335672:0:14443:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff89f188daba00/0x27a633fcdd4bc28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x27a633fcdd4bc2f expref: -99 pid: 15137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.335680:0:14443:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff89f188daba00/0x27a633fcdd4bc28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x27a633fcdd4bc2f expref: -99 pid: 15137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788940644.335686:0:14443:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff89f188daba00/0x27a633fcdd4bc28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x27a633fcdd4bc2f expref: -99 pid: 15137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940644.335691:0:14443:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788940644.335701:0:14443:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff89f188daba00/0x27a633fcdd4bc28 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4bc2f expref: -99 pid: 15137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.335707:0:14443:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788940644.335724:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff89f188daba00/0x27a633fcdd4bc28 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4bc2f expref: -99 pid: 15137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.335740:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff89f188daba00/0x27a633fcdd4bc28 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4bc2f expref: -99 pid: 15137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.335749:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940644.335752:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff89f188daa000/0x27a633fcdd4bbdb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4bbe2 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.335757:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188daa000 already unused, calling callback (ffffffffc1d10c20) 10000000:00010000:3.0:1788940644.335761:0:14443:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff89f188daa000/0x27a633fcdd4bbdb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x27a633fcdd4bbe2 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.335768:0:14443:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff89f188daa000/0x27a633fcdd4bbdb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x27a633fcdd4bbe2 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788940644.335774:0:14443:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff89f188daa000/0x27a633fcdd4bbdb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x27a633fcdd4bbe2 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940644.335779:0:14443:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788940644.335789:0:14443:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff89f188daa000/0x27a633fcdd4bbdb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4bbe2 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.335794:0:14443:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788940644.335799:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff89f188daa000/0x27a633fcdd4bbdb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4bbe2 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.335805:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff89f188daa000/0x27a633fcdd4bbdb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4bbe2 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.335818:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940644.335823:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940644.335825:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940644.335832:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940644.335855:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b55a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3308:1875839738297728:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788940644.335892:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940644.335939:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b55a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3305:1875839738297856:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788940644.335963:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940644.335979:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788940644.335984:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b55ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3305:1875839738297984:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788940644.336003:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940644.336044:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738297728 00000100:00100000:3.0:1788940644.336048:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738297728 00010000:00010000:3.0:1788940644.336072:0:14439:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89f19258c400/0x27a633fcdd4bd63 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4bd5c expref: 19 pid: 14449 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940644.336090:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738297856 00000100:00100000:3.0:1788940644.336092:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738297856 00010000:00010000:3.0:1788940644.336102:0:14439:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89f1bfa96200/0x27a633fcdd4bc2f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4bc28 expref: 20 pid: 14449 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940644.336110:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738297984 00000100:00100000:3.0:1788940644.336112:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738297984 00010000:00010000:3.0:1788940644.336120:0:14439:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89f19258c800/0x27a633fcdd4bbe2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4bbdb expref: 21 pid: 14449 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940644.336131:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788940644.336137:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b55a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+21:3308:x1875839738297728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788940644.336148:0:14439:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940644.336154:0:14439:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89f19258c400/0x27a633fcdd4bd63 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4bd5c expref: 21 pid: 14449 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.336169:0:14439:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89f19258c400/0x27a633fcdd4bd63 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27a633fcdd4bd5c expref: 21 pid: 14449 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.336188:0:14439:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940644.336217:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b55a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+21:3308:x1875839738297728:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940644.336224:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788940644.336239:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788940644.336244:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1baad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+20:3305:x1875839738297856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788940644.336251:0:14439:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940644.336255:0:14439:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89f1bfa96200/0x27a633fcdd4bc2f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4bc28 expref: 20 pid: 14449 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.336262:0:14439:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89f1bfa96200/0x27a633fcdd4bc2f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27a633fcdd4bc28 expref: 20 pid: 14449 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.336271:0:14439:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940644.336295:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1baad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+20:3305:x1875839738297856:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940644.336301:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788940644.336313:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788940644.336319:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b709d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+19:3305:x1875839738297984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788940644.336326:0:14439:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940644.336330:0:14439:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89f19258c800/0x27a633fcdd4bbe2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4bbdb expref: 19 pid: 14449 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.336338:0:14439:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89f19258c800/0x27a633fcdd4bbe2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27a633fcdd4bbdb expref: 19 pid: 14449 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.336353:0:14439:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940644.336375:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b709d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+19:3305:x1875839738297984:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940644.336381:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788940644.336451:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b55a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3308:1875839738297728:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788940644.336479:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b55ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3305:1875839738297984:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788940644.336487:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b55a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3305:1875839738297856:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788940644.336925:0:16573:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f19258c400/0x27a633fcdd4bd63 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27a633fcdd4bd5c expref: 18 pid: 14449 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940644.336940:0:16573:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f083edd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16573:1875839738297344:0@lo:104: 00010000:00010000:0.0:1788940644.336951:0:16573:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f1bfa96200/0x27a633fcdd4bc2f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27a633fcdd4bc28 expref: 17 pid: 14449 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940644.336960:0:16573:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bfbedc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16573:1875839738297472:0@lo:104: 00010000:00010000:0.0:1788940644.336970:0:16573:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f19258c800/0x27a633fcdd4bbe2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27a633fcdd4bbdb expref: 16 pid: 14449 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940644.336978:0:16573:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bfbeed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16573:1875839738297600:0@lo:104: 00000100:00100000:1.0:1788940644.341975:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940644.342067:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718376832 00000100:00100000:3.0:1788940644.342079:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718376832 00010000:00010000:3.0:1788940644.342136:0:14439:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89f1bfa97800/0x27a633fcdd4bec1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5bcc expref: 13 pid: 14449 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940644.342192:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 7 00000100:00100000:3.0:1788940644.342203:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4c24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:584847da-857b-4e92-a9b9-d2025c0d7e63+13:2352:x1875839718376832:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940644.342222:0:14439:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940644.342229:0:14439:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89f1bfa97800/0x27a633fcdd4bec1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5bcc expref: 13 pid: 14449 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.342244:0:14439:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89f1bfa97800/0x27a633fcdd4bec1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5bcc expref: 13 pid: 14449 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.342271:0:14439:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940644.342343:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4c24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:584847da-857b-4e92-a9b9-d2025c0d7e63+13:2352:x1875839718376832:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 141us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940644.342352:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 7 00010000:00010000:0.0:1788940644.343606:0:16573:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f1bfa97800/0x27a633fcdd4bec1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5bcc expref: 12 pid: 14449 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940644.343783:0:16573:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f083ede300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16573:1875839738297088:192.168.202.14@tcp:104: 00000100:00100000:0.0:1788940644.343815:0:16573:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f083edf800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16573:1875839738297216:192.168.202.14@tcp:104: 00010000:00010000:0.0:1788940644.343961:0:16573:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89f0812eb000/0x27a633fcdd4beeb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940644.352872:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940644.353181:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718376960 00000100:00100000:0.0:1788940644.353199:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718376960 00010000:00010000:0.0:1788940644.353260:0:14441:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89f1bfa97400/0x27a633fcdd4be89 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5b6a expref: 12 pid: 14449 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940644.353316:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 8 00000100:00100000:0.0:1788940644.353327:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf557480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:584847da-857b-4e92-a9b9-d2025c0d7e63+12:2353:x1875839718376960:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940644.353345:0:14441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940644.353353:0:14441:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89f1bfa97400/0x27a633fcdd4be89 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5b6a expref: 12 pid: 14449 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940644.353368:0:14441:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89f1bfa97400/0x27a633fcdd4be89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5b6a expref: 12 pid: 14449 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940644.353391:0:14441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f1bfa97400/0x27a633fcdd4be89 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5b6a expref: 12 pid: 14449 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940644.353415:0:14441:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89f0812eb000/0x27a633fcdd4beeb lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940644.353425:0:14441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f0812eb000/0x27a633fcdd4beeb lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940644.353445:0:14441:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89f0812eb000/0x27a633fcdd4beeb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940644.353475:0:14441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89f0812eb000/0x27a633fcdd4beeb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940644.353483:0:14441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89f0812eb000/0x27a633fcdd4beeb lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940644.353490:0:14441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89f0812eb000/0x27a633fcdd4beeb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940644.353498:0:14441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f0812eb000 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:0.0:1788940644.353503:0:14441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89f0812eb000/0x27a633fcdd4beeb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940644.353513:0:14441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89f0812eb000/0x27a633fcdd4beeb lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940644.353566:0:14441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89f0812eb000/0x27a633fcdd4beeb lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940644.353579:0:14441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788940644.353856:0:16573:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89f0812eb000/0x27a633fcdd4beeb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940644.353866:0:16573:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89f0812eb000/0x27a633fcdd4beeb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940644.353872:0:16573:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f0812eb000/0x27a633fcdd4beeb lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940644.355029:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf557480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:584847da-857b-4e92-a9b9-d2025c0d7e63+11:2353:x1875839718376960:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 1692us (2171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940644.355044:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 8 00010000:00010000:0.0:1788940645.039974:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788940645.740738:0:14451:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788940645.740756:0:14451:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89f1b69b5800 from 10 10000000:01000000:0.0:1788940645.740763:0:14451:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788940645.740847:0:14451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f0812eb400/0x27a633fcdd4bef2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940645.741079:0:14451:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f0812eb400/0x27a633fcdd4bef2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940645.741096:0:14451:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f0812eb400/0x27a633fcdd4bef2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940645.741131:0:14451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bfbeed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14451:1875839738298112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788940645.741246:0:14451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940645.741310:0:14451:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f195e87180 going to sleep for 11 seconds 00000100:00100000:3.0:1788940645.742686:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738298112 00000100:00100000:3.0:1788940645.742704:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738298112 00000100:00100000:3.0:1788940645.743438:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788940645.743456:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1af527850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+16:14451:x1875839738298112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788940645.743481:0:14446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940645.743508:0:14446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f1bfa96800/0x27a633fcdd4bef9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4bef2 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940645.743568:0:14446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f1bfa96800/0x27a633fcdd4bef9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4bef2 expref: 17 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940645.743582:0:14446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f1bfa96800/0x27a633fcdd4bef9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4bef2 expref: 17 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940645.743594:0:14446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f1bfa96800, rc 0) 00000100:00100000:3.0:1788940645.743698:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1af527850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+17:14451:x1875839738298112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 246us (2452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940645.743707:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788940645.743748:0:14451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bfbeed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14451:1875839738298112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788940645.743781:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f0812eb400/0x27a633fcdd4bef2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4bef9 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940645.743793:0:14451:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f0812eb400/0x27a633fcdd4bef2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4bef9 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940645.743917:0:14451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bfbeed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14451:1875839738298240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788940645.743958:0:14451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940645.748832:0:14451:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f195e87180 going to sleep for 11 seconds 00000100:00100000:2.0:1788940645.751162:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738298240 00000100:00100000:2.0:1788940645.751185:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738298240 00000100:00100000:0.0:1788940645.758281:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788940645.758302:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1af526050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+17:14451:x1875839738298240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788940645.758821:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1af526050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+17:14451:x1875839738298240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 513us (14852us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940645.758838:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788940645.760116:0:14451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bfbeed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14451:1875839738298240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788940645.760205:0:14451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1baad4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14451:1875839738298368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788940645.760293:0:14451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940645.770167:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738298368 00000100:00100000:1.0:1788940645.770188:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738298368 00000100:00100000:3.0:1788940645.770232:0:14451:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1aeec60c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788940645.770270:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788940645.770283:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1af525050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+17:14451:x1875839738298368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788940645.770623:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1af525050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+17:14451:x1875839738298368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 342us (10330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940645.770645:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788940645.770760:0:14451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1baad4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14451:1875839738298368:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788940645.775963:0:16615:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788940645.776368:0:14451:0:(obd_config.c:2244:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788940645.776396:0:14451:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788940645.776412:0:14451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f0812eb400/0x27a633fcdd4bef2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4bef9 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940645.776439:0:14451:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f0812eb400/0x27a633fcdd4bef2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4bef9 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940645.776461:0:14451:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788940645.776464:0:14451:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89f1af528800 from 10 10000000:01000000:1.0:1788940645.776468:0:14451:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788940645.776552:0:14451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f19258c800/0x27a633fcdd4bf00 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940645.776561:0:14451:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f19258c800/0x27a633fcdd4bf00 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940645.776575:0:14451:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f19258c800/0x27a633fcdd4bf00 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940645.776610:0:14451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4c25880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14451:1875839738298496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788940645.776726:0:14451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940645.777291:0:14451:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1a02386c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788940645.777354:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738298496 00000100:00100000:1.0:1788940645.777364:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738298496 00000100:00100000:1.0:1788940645.777478:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788940645.777490:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1af524c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+17:14451:x1875839738298496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788940645.777510:0:14449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940645.777591:0:14449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f19258c400/0x27a633fcdd4bf07 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4bf00 expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940645.778291:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f19258c400/0x27a633fcdd4bf07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4bf00 expref: 18 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940645.778324:0:14449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f19258c400/0x27a633fcdd4bf07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4bf00 expref: 18 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940645.778335:0:14449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f19258c400, rc 0) 00000100:00100000:1.0:1788940645.778465:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1af524c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+18:14451:x1875839738298496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 976us (1749us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940645.778472:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788940645.778564:0:14451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4c25880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14451:1875839738298496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788940645.778583:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f19258c800/0x27a633fcdd4bf00 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4bf07 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940645.778593:0:14451:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f19258c800/0x27a633fcdd4bf00 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4bf07 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940645.779309:0:14451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4c25880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14451:1875839738298624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788940645.779402:0:14451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940645.779465:0:14451:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1a02386c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940645.780388:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738298624 00000100:00100000:2.0:1788940645.780401:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738298624 00000100:00100000:2.0:1788940645.780554:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788940645.780579:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1af524050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+18:14451:x1875839738298624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788940645.781514:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1af524050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+18:14451:x1875839738298624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 933us (2107us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940645.781929:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788940645.782166:0:14451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4c25880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14451:1875839738298624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788940645.782236:0:14451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4c25880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14451:1875839738298752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788940645.782297:0:14451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940645.782342:0:14451:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1a02386c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940645.782436:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738298752 00000100:00100000:2.0:1788940645.782451:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738298752 00000100:00100000:2.0:1788940645.782666:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788940645.782687:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1af525450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+18:14451:x1875839738298752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788940645.782943:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1af525450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+18:14451:x1875839738298752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 257us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940645.782950:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788940645.783064:0:14451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4c25880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14451:1875839738298752:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788940645.788737:0:16616:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788940645.790172:0:14451:0:(obd_config.c:2244:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788940645.790209:0:14451:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788940645.790225:0:14451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f19258c800/0x27a633fcdd4bf00 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4bf07 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940645.790241:0:14451:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f19258c800/0x27a633fcdd4bf00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4bf07 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940645.790255:0:14451:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788940645.790259:0:14451:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89f1b0c14800 from 10 10000000:01000000:1.0:1788940645.790263:0:14451:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788940645.790327:0:14451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f19258d400/0x27a633fcdd4bf0e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940645.790336:0:14451:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f19258d400/0x27a633fcdd4bf0e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940645.790352:0:14451:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f19258d400/0x27a633fcdd4bf0e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940645.790390:0:14451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4c25880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14451:1875839738298880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788940645.790504:0:14451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940645.790572:0:14451:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1a02386c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940645.791137:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738298880 00000100:00100000:2.0:1788940645.791150:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738298880 00000100:00100000:2.0:1788940645.791224:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788940645.791237:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1af527c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+18:14451:x1875839738298880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788940645.791256:0:14448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940645.791276:0:14448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f181521000/0x27a633fcdd4bf15 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4bf0e expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940645.791309:0:14448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f181521000/0x27a633fcdd4bf15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4bf0e expref: 19 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940645.791321:0:14448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f181521000/0x27a633fcdd4bf15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4bf0e expref: 19 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940645.791331:0:14448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f181521000, rc 0) 00000100:00100000:2.0:1788940645.791396:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1af527c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+19:14451:x1875839738298880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940645.791402:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788940645.791471:0:14451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4c25880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14451:1875839738298880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788940645.791489:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f19258d400/0x27a633fcdd4bf0e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4bf15 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940645.791498:0:14451:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f19258d400/0x27a633fcdd4bf0e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4bf15 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940645.791616:0:14451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf555500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14451:1875839738299008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788940645.791661:0:14451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940645.791680:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738299008 00000100:00100000:3.0:1788940645.791686:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738299008 00000100:00100000:2.0:1788940645.791700:0:14451:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f0812bc840 going to sleep for 11 seconds 00000100:00100000:3.0:1788940645.791726:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788940645.791734:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1af524450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+19:14451:x1875839738299008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788940645.795094:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1af524450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+19:14451:x1875839738299008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 3347us (3419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940645.795125:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788940645.795239:0:14451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf555500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14451:1875839738299008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788940645.795318:0:14451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1baad4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14451:1875839738299136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788940645.795381:0:14451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940645.795434:0:14451:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1aeec69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940645.796285:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738299136 00000100:00100000:2.0:1788940645.796300:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738299136 00000100:00100000:2.0:1788940645.799239:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788940645.799270:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1af525850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+19:14451:x1875839738299136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788940645.800052:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1af525850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+19:14451:x1875839738299136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 793us (4667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940645.800065:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788940645.800244:0:14451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1baad4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:14451:1875839738299136:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788940645.806459:0:16617:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788940645.808167:0:14451:0:(obd_config.c:2244:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788940645.808214:0:14451:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788940645.808228:0:14451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f19258d400/0x27a633fcdd4bf0e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4bf15 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940645.808260:0:14451:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f19258d400/0x27a633fcdd4bf0e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4bf15 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940645.818417:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940645.819416:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718377088 00000100:00100000:0.0:1788940645.819433:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718377088 00000100:00100000:0.0:1788940645.819534:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 117 00000100:00100000:0.0:1788940645.819548:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1af524850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:584847da-857b-4e92-a9b9-d2025c0d7e63+11:13779:x1875839718377088:12345-192.168.202.14@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788940645.819570:0:14449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940645.819595:0:14449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f0812ea000/0x27a633fcdd4bf1c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5bfd expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940645.819645:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f0812ea000/0x27a633fcdd4bf1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5bfd expref: 12 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940645.819661:0:14449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f0812ea000/0x27a633fcdd4bf1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5bfd expref: 12 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940645.819672:0:14449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f0812ea000, rc 0) 00000100:00100000:0.0:1788940645.819769:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1af524850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:584847da-857b-4e92-a9b9-d2025c0d7e63+12:13779:x1875839718377088:12345-192.168.202.14@tcp:101:ll_cfg_requeue.0 Request processed in 224us (1367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940645.819777:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 117 00000100:00100000:1.0:1788940645.835654:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940645.836637:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718377216 00000100:00100000:2.0:1788940645.836653:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718377216 00000100:00100000:2.0:1788940645.836739:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 118 00000100:00100000:2.0:1788940645.837002:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1af526450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:584847da-857b-4e92-a9b9-d2025c0d7e63+12:13779:x1875839718377216:12345-192.168.202.14@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788940645.838356:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1af526450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:584847da-857b-4e92-a9b9-d2025c0d7e63+12:13779:x1875839718377216:12345-192.168.202.14@tcp:501:ll_cfg_requeue.0 Request processed in 1595us (2705us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940645.838370:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 118 00000100:00100000:2.0:1788940645.853052:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940645.853206:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718377344 00000100:00100000:3.0:1788940645.853220:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718377344 00000100:00100000:3.0:1788940645.853327:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 119 00000100:00100000:3.0:1788940645.853341:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b53ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:584847da-857b-4e92-a9b9-d2025c0d7e63+12:13779:x1875839718377344:12345-192.168.202.14@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788940645.853926:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b53ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:584847da-857b-4e92-a9b9-d2025c0d7e63+12:13779:x1875839718377344:12345-192.168.202.14@tcp:503:ll_cfg_requeue.0 Request processed in 585us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940645.853936:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 119 00000100:00100000:0.0:1788940645.876551:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940645.878248:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718377472 00000100:00100000:2.0:1788940645.878265:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718377472 00000100:00100000:2.0:1788940645.878337:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 120 00000100:00100000:2.0:1788940645.878349:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b53ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:584847da-857b-4e92-a9b9-d2025c0d7e63+12:13779:x1875839718377472:12345-192.168.202.14@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788940645.878371:0:14446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940645.878393:0:14446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f181520400/0x27a633fcdd4bf23 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5c04 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940645.878442:0:14446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f181520400/0x27a633fcdd4bf23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c04 expref: 13 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940645.878456:0:14446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f181520400/0x27a633fcdd4bf23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c04 expref: 13 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940645.878467:0:14446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f181520400, rc 0) 00000100:00100000:2.0:1788940645.879986:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b53ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:584847da-857b-4e92-a9b9-d2025c0d7e63+13:13779:x1875839718377472:12345-192.168.202.14@tcp:101:ll_cfg_requeue.0 Request processed in 1629us (3459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940645.880007:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 120 00000100:00100000:2.0:1788940645.887561:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940645.887643:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718377600 00000100:00100000:2.0:1788940645.887657:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718377600 00000100:00100000:0.0:1788940645.888351:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 121 00000100:00100000:0.0:1788940645.888369:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b53af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:584847da-857b-4e92-a9b9-d2025c0d7e63+13:13779:x1875839718377600:12345-192.168.202.14@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788940645.888946:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b53af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:584847da-857b-4e92-a9b9-d2025c0d7e63+13:13779:x1875839718377600:12345-192.168.202.14@tcp:501:ll_cfg_requeue.0 Request processed in 579us (1399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940645.888957:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 121 00000100:00100000:3.0:1788940645.909022:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940645.909252:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718377728 00000100:00100000:0.0:1788940645.909267:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718377728 00000100:00100000:0.0:1788940645.909345:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 122 00000100:00100000:0.0:1788940645.909369:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b53ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:584847da-857b-4e92-a9b9-d2025c0d7e63+13:13779:x1875839718377728:12345-192.168.202.14@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788940645.909715:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b53ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:584847da-857b-4e92-a9b9-d2025c0d7e63+13:13779:x1875839718377728:12345-192.168.202.14@tcp:503:ll_cfg_requeue.0 Request processed in 347us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940645.909724:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 122 00010000:00010000:3.0:1788940646.062040:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940646.906582:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940646.906625:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940646.906644:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940646.906676:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940646.906696:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940646.906717:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940646.906741:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940646.906768:0:15139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718378240 00000100:00100000:0.0:1788940646.906781:0:15139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718378240 00000100:00100000:0.0:1788940646.906862:0:15139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718378496 00000100:00100000:0.0:1788940646.906865:0:15139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718378496 00000100:00100000:0.0:1788940646.906880:0:15139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718378112 00000100:00100000:0.0:1788940646.906883:0:15139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718378112 00000100:00100000:0.0:1788940646.906897:0:15139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718378624 00000100:00100000:0.0:1788940646.906899:0:15139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718378624 00000100:00100000:0.0:1788940646.906916:0:15139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 11 00000100:00100000:0.0:1788940646.906929:0:15139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b800dac5-5ff3-48f9-949d-d7448f32aa11+5:2350:x1875839718378240:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788940646.907036:0:15139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b800dac5-5ff3-48f9-949d-d7448f32aa11+5:2350:x1875839718378240:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 109us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940646.907044:0:15139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 11 00000100:00100000:0.0:1788940646.907065:0:15139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 12 00000100:00100000:0.0:1788940646.907073:0:15139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36f240b4-a296-44d9-a5c6-bed8adad0c38+5:2350:x1875839718378496:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788940646.907100:0:15139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36f240b4-a296-44d9-a5c6-bed8adad0c38+5:2350:x1875839718378496:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 28us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940646.907119:0:15139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 12 00000100:00100000:0.0:1788940646.907131:0:15139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 13 00000100:00100000:0.0:1788940646.907138:0:15139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b800dac5-5ff3-48f9-949d-d7448f32aa11+5:2350:x1875839718378112:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788940646.907163:0:15139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b800dac5-5ff3-48f9-949d-d7448f32aa11+5:2350:x1875839718378112:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 26us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940646.907169:0:15139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 13 00000100:00100000:0.0:1788940646.907177:0:15139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 14 00000100:00100000:0.0:1788940646.907183:0:15139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36f240b4-a296-44d9-a5c6-bed8adad0c38+5:2350:x1875839718378624:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788940646.907203:0:15139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36f240b4-a296-44d9-a5c6-bed8adad0c38+5:2350:x1875839718378624:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 20us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940646.907208:0:15139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 14 00000100:00100000:0.0:1788940646.907231:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718377984 00000100:00100000:0.0:1788940646.907235:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718377984 00000100:00100000:0.0:1788940646.907264:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718378368 00000100:00100000:0.0:1788940646.907267:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718378368 00000100:00100000:0.0:1788940646.907282:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 25 00000100:00100000:0.0:1788940646.907287:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b800dac5-5ff3-48f9-949d-d7448f32aa11+6:2350:x1875839718377984:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788940646.907316:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b800dac5-5ff3-48f9-949d-d7448f32aa11+6:2350:x1875839718377984:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 28us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940646.907322:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 25 00000100:00100000:0.0:1788940646.907335:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 26 00000100:00100000:0.0:1788940646.907341:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36f240b4-a296-44d9-a5c6-bed8adad0c38+6:2350:x1875839718378368:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788940646.907365:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36f240b4-a296-44d9-a5c6-bed8adad0c38+6:2350:x1875839718378368:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 24us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940646.907378:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 26 00000100:00080000:0.0:1788940646.907407:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788940646.907413:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788940646.907414:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788940646.910604:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718377856 00000100:00100000:2.0:1788940646.910626:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718377856 00000100:00100000:2.0:1788940646.910719:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 123 00000100:00100000:2.0:1788940646.910731:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b53afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:584847da-857b-4e92-a9b9-d2025c0d7e63+13:2350:x1875839718377856:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788940646.911029:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b53afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:584847da-857b-4e92-a9b9-d2025c0d7e63+13:2350:x1875839718377856:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 297us (4349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940646.911037:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 123 00010000:00010000:2.0:1788940647.091829:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940647.919454:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4c27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738299264:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788940647.919566:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940647.919669:0:15143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738299264 00000100:00100000:1.0:1788940647.919677:0:15143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738299264 00000100:00100000:1.0:1788940647.919737:0:15143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788940647.919747:0:15143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4c25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738299264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788940647.919783:0:15143:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788940647.919832:0:15143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4c25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738299264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (267us total) trans 0 rc 0/0 00000100:00080000:0.0:1788940647.919930:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788940647.919940:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f083edf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738299520:0@lo:400:kworker.0 00000100:00100000:3.0:1788940647.919991:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940647.920007:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bfbee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738299776:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788940647.920038:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f083edc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875839738300032:0@lo:400:kworker.0 00000100:00100000:0.0:1788940647.920044:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940647.920076:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940647.920109:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4c27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738299264:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788940647.920126:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788940647.920131:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1baad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3307:1875839738299392:0@lo:400:kworker.0 00000100:00100000:0.0:1788940647.920157:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940647.920177:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f083edd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875839738299904:0@lo:400:kworker.0 00000100:00100000:3.0:1788940647.920193:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788940647.920200:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940647.920204:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f083ede300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875839738299648:0@lo:400:kworker.0 00000100:00100000:0.0:1788940647.920224:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738300032 00000100:00100000:0.0:1788940647.920229:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738300032 00000100:00100000:3.0:1788940647.920239:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940647.920258:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738299904 00000100:00100000:0.0:1788940647.920262:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738299904 00000100:00100000:0.0:1788940647.920275:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738299648 00000100:00100000:0.0:1788940647.920277:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738299648 00000100:00100000:3.0:1788940647.920284:0:15139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738299520 00000100:00100000:3.0:1788940647.920290:0:15139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738299520 00000100:00100000:0.0:1788940647.920292:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788940647.920298:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b55ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875839738300032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940647.920342:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b55ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875839738300032:12345-0@lo:400:kworker.0 Request processed in 44us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940647.920350:0:15139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788940647.920351:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788940647.920363:0:15139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b55a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738299520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940647.920373:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788940647.920381:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875839738299904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940647.920419:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875839738299904:12345-0@lo:400:kworker.0 Request processed in 40us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940647.920425:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788940647.920434:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788940647.920438:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b55a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875839738299648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940647.920456:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b55a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875839738299648:12345-0@lo:400:kworker.0 Request processed in 18us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940647.920461:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1788940647.920472:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788940647.920475:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788940647.920489:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f083edd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875839738299904:0@lo:400:kworker.0 00000100:00100000:0.0:1788940647.920514:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738299392 00000100:00100000:0.0:1788940647.920536:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738299392 00000100:00100000:0.0:1788940647.920562:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788940647.920569:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b53adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+19:3307:x1875839738299392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940647.920600:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b53adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+19:3307:x1875839738299392:12345-0@lo:400:kworker.0 Request processed in 32us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940647.920607:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788940647.920641:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1baad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3307:1875839738299392:0@lo:400:kworker.0 00000100:00100000:3.0:1788940647.920646:0:15139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b55a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738299520:12345-0@lo:400:kworker.0 Request processed in 283us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940647.920656:0:15139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788940647.920679:0:15142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738299776 00000100:00100000:0.0:1788940647.920684:0:15142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738299776 00000100:00100000:3.0:1788940647.920702:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f083ede300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875839738299648:0@lo:400:kworker.0 00000100:00100000:3.0:1788940647.920714:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f083edf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738299520:0@lo:400:kworker.0 00000100:00100000:3.0:1788940647.920722:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f083edc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875839738300032:0@lo:400:kworker.0 00000100:00100000:1.0:1788940647.925801:0:15143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788940647.937236:0:15142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788940647.937262:0:15142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738299776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788940647.937301:0:15142:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788940647.937382:0:15142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738299776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (17341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940647.937403:0:15142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788940647.937427:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bfbee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738299776:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788940648.108687:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940649.132710:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940649.138502:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940649.138627:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718378752 00000100:00100000:2.0:1788940649.138636:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718378752 00000100:00080000:0.0:1788940649.138682:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940649.138712:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 15 00000100:00100000:2.0:1788940649.138859:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b800dac5-5ff3-48f9-949d-d7448f32aa11+6:14435:x1875839718378752:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788940649.138890:0:14455:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940649.138908:0:14455:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520c00/0x27a633fcdd4bf2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5c0b expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.139022:0:14455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520000/0x27a633fcdd4bf31 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.139033:0:14455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520000/0x27a633fcdd4bf31 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.139042:0:14455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520000/0x27a633fcdd4bf31 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.139050:0:14455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521a00/0x27a633fcdd4bf38 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.139055:0:14455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521a00/0x27a633fcdd4bf38 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.139059:0:14455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521a00/0x27a633fcdd4bf38 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.139332:0:14455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521c00/0x27a633fcdd4bf3f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.139340:0:14455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521c00/0x27a633fcdd4bf3f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.139347:0:14455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521c00/0x27a633fcdd4bf3f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940649.139374:0:14455:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788940649.139383:0:14455:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788940649.139420:0:14455:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521c00/0x27a633fcdd4bf3f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.139430:0:14455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520000/0x27a633fcdd4bf31 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.139436:0:14455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520000/0x27a633fcdd4bf31 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.139442:0:14455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520000/0x27a633fcdd4bf31 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.139447:0:14455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f181520000 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940649.139451:0:14455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520000/0x27a633fcdd4bf31 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.139458:0:14455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520000/0x27a633fcdd4bf31 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.139468:0:14455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f186931600) 00010000:00010000:2.0:1788940649.139471:0:14455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940649.139475:0:14455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520000/0x27a633fcdd4bf31 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.139481:0:14455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520000/0x27a633fcdd4bf31 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.139492:0:14455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521a00/0x27a633fcdd4bf38 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.139497:0:14455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521a00/0x27a633fcdd4bf38 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.139511:0:14455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521a00/0x27a633fcdd4bf38 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.139564:0:14455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f181521a00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940649.139568:0:14455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521a00/0x27a633fcdd4bf38 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.139574:0:14455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521a00/0x27a633fcdd4bf38 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.139583:0:14455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff89f186931300) 00010000:00010000:2.0:1788940649.139586:0:14455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940649.139590:0:14455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521a00/0x27a633fcdd4bf38 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.139596:0:14455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521a00/0x27a633fcdd4bf38 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.139637:0:14455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520c00/0x27a633fcdd4bf2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c0b expref: 8 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.139649:0:14455:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521c00/0x27a633fcdd4bf3f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c0b expref: 7 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.139656:0:14455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff89f186931900) 00010000:00010000:2.0:1788940649.139659:0:14455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788940649.139661:0:14455:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f181521c00, rc 0) 00000100:00100000:2.0:1788940649.139727:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b800dac5-5ff3-48f9-949d-d7448f32aa11+7:14435:x1875839718378752:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 872us (1235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940649.142322:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940649.142571:0:14456:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788940649.142586:0:14456:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1788940649.142868:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718379008 00000100:00100000:1.0:1788940649.142882:0:14456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718379008 00000100:00100000:2.0:1788940649.145100:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 15 00000100:00100000:1.0:1788940649.151966:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 16 00000100:00100000:1.0:1788940649.152007:0:14456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b55a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b800dac5-5ff3-48f9-949d-d7448f32aa11+7:14435:x1875839718379008:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788940649.152041:0:14456:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940649.152088:0:14456:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4bf46 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5c12 expref: -99 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940649.152191:0:14456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d600/0x27a633fcdd4bf4d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940649.152224:0:14456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d600/0x27a633fcdd4bf4d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940649.152240:0:14456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d600/0x27a633fcdd4bf4d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940649.152261:0:14456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258da00/0x27a633fcdd4bf54 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940649.152268:0:14456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258da00/0x27a633fcdd4bf54 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940649.152274:0:14456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258da00/0x27a633fcdd4bf54 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940649.152926:0:14456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4bf5b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940649.152938:0:14456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4bf5b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940649.152947:0:14456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4bf5b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940649.152969:0:14456:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1788940649.153224:0:14456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d600/0x27a633fcdd4bf4d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940649.153233:0:14456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d600/0x27a633fcdd4bf4d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940649.153241:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d600/0x27a633fcdd4bf4d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940649.153254:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258d600 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940649.153260:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d600/0x27a633fcdd4bf4d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940649.153269:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d600/0x27a633fcdd4bf4d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940649.153285:0:14456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff89f186931900) 00010000:00010000:1.0:1788940649.153288:0:14456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940649.153295:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d600/0x27a633fcdd4bf4d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940649.153302:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d600/0x27a633fcdd4bf4d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940649.153315:0:14456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258da00/0x27a633fcdd4bf54 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940649.153321:0:14456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258da00/0x27a633fcdd4bf54 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940649.153328:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258da00/0x27a633fcdd4bf54 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940649.153333:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258da00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940649.153336:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258da00/0x27a633fcdd4bf54 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940649.153342:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258da00/0x27a633fcdd4bf54 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940649.153359:0:14456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff89f188f81300) 00010000:00010000:1.0:1788940649.153362:0:14456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940649.153366:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258da00/0x27a633fcdd4bf54 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940649.153372:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258da00/0x27a633fcdd4bf54 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940649.157190:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4bf46 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c12 expref: 10 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940649.157234:0:14456:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4bf5b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c12 expref: 9 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940649.157245:0:14456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89f188f81400) 00010000:00010000:1.0:1788940649.157248:0:14456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940649.157253:0:14456:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f19258d000, rc 0) 00000100:00100000:1.0:1788940649.157355:0:14456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b55a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b800dac5-5ff3-48f9-949d-d7448f32aa11+9:14435:x1875839718379008:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 5369us (15044us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788940649.157367:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 16 00000100:00100000:3.0:1788940649.160460:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940649.160508:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718379136 00000100:00100000:2.0:1788940649.160639:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718379136 00000100:00100000:2.0:1788940649.160726:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 17 00000100:00100000:2.0:1788940649.160738:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f191021f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b800dac5-5ff3-48f9-949d-d7448f32aa11+9:14435:x1875839718379136:12345-192.168.202.14@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788940649.160903:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f191021f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b800dac5-5ff3-48f9-949d-d7448f32aa11+9:14435:x1875839718379136:12345-192.168.202.14@tcp:59:lhsmtool_posix.0 Request processed in 166us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940649.160910:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 17 00000100:00100000:0.0:1788940649.245132:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940649.245505:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718379264 00000100:00100000:2.0:1788940649.245534:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718379264 00000100:00100000:2.0:1788940649.245648:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 18 00000100:00100000:2.0:1788940649.245659:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b800dac5-5ff3-48f9-949d-d7448f32aa11+9:14441:x1875839718379264:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:2.0:1788940649.245683:0:14454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940649.245704:0:14454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520c00/0x27a633fcdd4bf69 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5c19 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.245781:0:14454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521a00/0x27a633fcdd4bf70 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.245797:0:14454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521a00/0x27a633fcdd4bf70 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.245809:0:14454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521a00/0x27a633fcdd4bf70 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.245823:0:14454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520000/0x27a633fcdd4bf77 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.245849:0:14454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520000/0x27a633fcdd4bf77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.245857:0:14454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520000/0x27a633fcdd4bf77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.246064:0:14454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521a00/0x27a633fcdd4bf70 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.246072:0:14454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521a00/0x27a633fcdd4bf70 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.246080:0:14454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521a00/0x27a633fcdd4bf70 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.246085:0:14454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f181521a00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940649.246090:0:14454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521a00/0x27a633fcdd4bf70 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.246097:0:14454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521a00/0x27a633fcdd4bf70 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.246109:0:14454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f186931600) 00010000:00010000:2.0:1788940649.246112:0:14454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940649.246117:0:14454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521a00/0x27a633fcdd4bf70 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.246123:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521a00/0x27a633fcdd4bf70 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.246135:0:14454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520000/0x27a633fcdd4bf77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.246147:0:14454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520000/0x27a633fcdd4bf77 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.246152:0:14454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520000/0x27a633fcdd4bf77 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.246157:0:14454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f181520000 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940649.246160:0:14454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520000/0x27a633fcdd4bf77 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.246166:0:14454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520000/0x27a633fcdd4bf77 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.246187:0:14454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff89f186931300) 00010000:00010000:2.0:1788940649.246190:0:14454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940649.246193:0:14454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520000/0x27a633fcdd4bf77 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.246199:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520000/0x27a633fcdd4bf77 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.246228:0:14454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520c00/0x27a633fcdd4bf69 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c19 expref: 10 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.246237:0:14454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f186931600) 00010000:00010000:2.0:1788940649.246239:0:14454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940649.246242:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520c00/0x27a633fcdd4bf69 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c19 expref: 10 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.246250:0:14454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f181520c00, rc 0) 00000100:00100000:2.0:1788940649.246323:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b800dac5-5ff3-48f9-949d-d7448f32aa11+9:14441:x1875839718379264:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 666us (1312us total) trans 0 rc 301/301 00000100:00100000:2.0:1788940649.246330:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 18 00000100:00100000:0.0:1788940649.258829:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940649.258956:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718379392 00000100:00100000:1.0:1788940649.258978:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718379392 00000100:00100000:1.0:1788940649.259034:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 0 00000100:00100000:1.0:1788940649.259045:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:b800dac5-5ff3-48f9-949d-d7448f32aa11+9:14441:x1875839718379392:12345-192.168.202.14@tcp:700:lfs.0 00000100:00100000:1.0:1788940649.259142:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:b800dac5-5ff3-48f9-949d-d7448f32aa11+9:14441:x1875839718379392:12345-192.168.202.14@tcp:700:lfs.0 Request processed in 98us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940649.259150:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 0 00000100:00100000:3.0:1788940649.281729:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940649.282009:0:16687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718379648 00000100:00100000:0.0:1788940649.282029:0:16687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718379648 00000100:00100000:0.0:1788940649.282098:0:16687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 19 00000100:00100000:0.0:1788940649.282110:0:16687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f191021880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b800dac5-5ff3-48f9-949d-d7448f32aa11+9:14441:x1875839718379648:12345-192.168.202.14@tcp:36:lfs.0 00010000:00010000:0.0:1788940649.282164:0:16687:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940649.282191:0:16687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521400/0x27a633fcdd4beac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5b94 expref: 9 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.282211:0:16687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f186931600) 00010000:00010000:0.0:1788940649.282217:0:16687:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788940649.283069:0:16687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea800/0x27a633fcdd4bf7e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.283091:0:16687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97000/0x27a633fcdd4bee4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5bf6 expref: 5 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.283100:0:16687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea800/0x27a633fcdd4bf7e lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.283153:0:16687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97000/0x27a633fcdd4bee4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5bf6 expref: 5 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.283169:0:16687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97000/0x27a633fcdd4bee4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5bf6 expref: 5 pid: 14454 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940649.283196:0:16687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bfbef480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16687:1875839738300160:192.168.202.14@tcp:104: 00000100:00100000:0.0:1788940649.283313:0:16687:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1863fa240 going to sleep for 11 seconds 00000100:00100000:3.0:1788940649.291407:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940649.291559:0:14440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718379776 00000100:00100000:1.0:1788940649.291571:0:14440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718379776 00000100:00080000:2.0:1788940649.291626:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788940649.291632:0:14440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97000/0x27a633fcdd4bee4 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5bf6 expref: 6 pid: 14454 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940649.291673:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 9 00000100:00100000:1.0:1788940649.291681:0:14440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f191020000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36f240b4-a296-44d9-a5c6-bed8adad0c38+6:2352:x1875839718379776:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788940649.291693:0:14440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940649.291698:0:14440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97000/0x27a633fcdd4bee4 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5bf6 expref: 6 pid: 14454 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940649.291709:0:14440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97000/0x27a633fcdd4bee4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5bf6 expref: 6 pid: 14454 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940649.291727:0:14440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f186931600) 00010000:00010000:1.0:1788940649.291732:0:14440:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea800/0x27a633fcdd4bf7e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940649.291739:0:14440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea800/0x27a633fcdd4bf7e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940649.291744:0:14440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea800/0x27a633fcdd4bf7e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940649.291758:0:14440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940649.291805:0:14440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f191020000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36f240b4-a296-44d9-a5c6-bed8adad0c38+6:2352:x1875839718379776:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 124us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940649.291813:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 9 00010000:00010000:0.0:1788940649.292368:0:16687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97000/0x27a633fcdd4bee4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5bf6 expref: 5 pid: 14454 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940649.292385:0:16687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bfbef480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16687:1875839738300160:192.168.202.14@tcp:104: 00010000:00010000:0.0:1788940649.292409:0:16687:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea800/0x27a633fcdd4bf7e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.292418:0:16687:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea800/0x27a633fcdd4bf7e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.292424:0:16687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea800/0x27a633fcdd4bf7e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.292447:0:16687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea200/0x27a633fcdd4bf85 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.292457:0:16687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea200/0x27a633fcdd4bf85 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.292464:0:16687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea200/0x27a633fcdd4bf85 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940649.294144:0:16687:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788940649.294161:0:16687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea800/0x27a633fcdd4bf7e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.294171:0:16687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea800/0x27a633fcdd4bf7e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.294187:0:16687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea800/0x27a633fcdd4bf7e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.294194:0:16687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f0812ea800 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:0.0:1788940649.294198:0:16687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea800/0x27a633fcdd4bf7e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.294209:0:16687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea800/0x27a633fcdd4bf7e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.294223:0:16687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f186931600) 00010000:00010000:0.0:1788940649.294226:0:16687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940649.294231:0:16687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea800/0x27a633fcdd4bf7e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.294237:0:16687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea800/0x27a633fcdd4bf7e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788940649.294257:0:16687:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006c589417 reply state 00000000a0fddf5e transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea200/0x27a633fcdd4bf85 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940649.294266:0:16687:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788940649.294376:0:16687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f191021880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b800dac5-5ff3-48f9-949d-d7448f32aa11+10:14441:x1875839718379648:12345-192.168.202.14@tcp:36:lfs.0 Request processed in 12265us (12654us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788940649.294387:0:16687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 19 00010000:00010000:2.0:1788940649.303479:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea200/0x27a633fcdd4bf85 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.303500:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea200/0x27a633fcdd4bf85 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.303508:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea200/0x27a633fcdd4bf85 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.303515:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f0812ea200 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940649.303594:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea200/0x27a633fcdd4bf85 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.303604:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea200/0x27a633fcdd4bf85 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.303621:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff89f185751600) 00010000:00010000:2.0:1788940649.303624:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940649.303630:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea200/0x27a633fcdd4bf85 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.303637:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea200/0x27a633fcdd4bf85 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940649.438514:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940649.440675:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718379904 00000100:00100000:1.0:1788940649.440712:0:14456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718379904 00000100:00100000:1.0:1788940649.440856:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 20 00000100:00100000:1.0:1788940649.440867:0:14456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf554380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b800dac5-5ff3-48f9-949d-d7448f32aa11+9:14449:x1875839718379904:12345-192.168.202.14@tcp:101:lctl.0 00010000:00010000:1.0:1788940649.440893:0:14456:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940649.440928:0:14456:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258da00/0x27a633fcdd4bf8c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5c20 expref: -99 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940649.441004:0:14456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d600/0x27a633fcdd4bf93 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940649.441161:0:14456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d600/0x27a633fcdd4bf93 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940649.441175:0:14456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d600/0x27a633fcdd4bf93 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940649.441215:0:14456:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788940649.441219:0:14456:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788940649.441261:0:14456:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d600/0x27a633fcdd4bf93 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940649.441287:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258da00/0x27a633fcdd4bf8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c20 expref: 11 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940649.441306:0:14456:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d600/0x27a633fcdd4bf93 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c20 expref: 10 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940649.441315:0:14456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f188f81300) 00010000:00010000:1.0:1788940649.441317:0:14456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788940649.441321:0:14456:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f19258d600, rc 0) 00000100:00100000:1.0:1788940649.441401:0:14456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf554380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b800dac5-5ff3-48f9-949d-d7448f32aa11+10:14449:x1875839718379904:12345-192.168.202.14@tcp:101:lctl.0 Request processed in 535us (2896us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940649.441408:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 20 00000100:00100000:0.0:1788940649.481492:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940649.481744:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718380032 00000100:00100000:2.0:1788940649.481755:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718380032 00000100:00100000:2.0:1788940649.481821:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 21 00000100:00100000:2.0:1788940649.481829:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36f240b4-a296-44d9-a5c6-bed8adad0c38+5:14450:x1875839718380032:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:2.0:1788940649.481850:0:14455:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940649.481869:0:14455:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520000/0x27a633fcdd4bf9a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5c27 expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.481929:0:14455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521a00/0x27a633fcdd4bfa1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.481942:0:14455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521a00/0x27a633fcdd4bfa1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.481953:0:14455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521a00/0x27a633fcdd4bfa1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940649.481999:0:14455:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788940649.482003:0:14455:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788940649.482674:0:14455:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521a00/0x27a633fcdd4bfa1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.482707:0:14455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520000/0x27a633fcdd4bf9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c27 expref: 7 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.482734:0:14455:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521a00/0x27a633fcdd4bfa1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c27 expref: 6 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.482741:0:14455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f188f81300) 00010000:00010000:2.0:1788940649.482743:0:14455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788940649.482746:0:14455:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f181521a00, rc 0) 00000100:00100000:3.0:1788940649.488622:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36f240b4-a296-44d9-a5c6-bed8adad0c38+6:14450:x1875839718380032:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 6779us (7124us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940649.488637:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 21 00000100:00100000:3.0:1788940649.494155:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940649.494270:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718380160 00000100:00100000:2.0:1788940649.494295:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718380160 00000100:00100000:2.0:1788940649.494360:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 22 00000100:00100000:2.0:1788940649.494369:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f191021c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36f240b4-a296-44d9-a5c6-bed8adad0c38+6:14450:x1875839718380160:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:2.0:1788940649.494391:0:14454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940649.494424:0:14454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520000/0x27a633fcdd4bfa8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5c2e expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.494505:0:14454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520800/0x27a633fcdd4bfaf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.494555:0:14454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520800/0x27a633fcdd4bfaf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.494569:0:14454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520800/0x27a633fcdd4bfaf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.494585:0:14454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520e00/0x27a633fcdd4bfb6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.494592:0:14454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520e00/0x27a633fcdd4bfb6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.494599:0:14454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520e00/0x27a633fcdd4bfb6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.494698:0:14454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521e00/0x27a633fcdd4bfbd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.494707:0:14454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521e00/0x27a633fcdd4bfbd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.494713:0:14454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521e00/0x27a633fcdd4bfbd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940649.494766:0:14454:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788940649.494770:0:14454:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788940649.494791:0:14454:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521e00/0x27a633fcdd4bfbd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.494804:0:14454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520800/0x27a633fcdd4bfaf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.494811:0:14454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520800/0x27a633fcdd4bfaf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.494818:0:14454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520800/0x27a633fcdd4bfaf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.494825:0:14454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f181520800 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940649.494830:0:14454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520800/0x27a633fcdd4bfaf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.494838:0:14454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520800/0x27a633fcdd4bfaf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.494850:0:14454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f188f81300) 00010000:00010000:2.0:1788940649.494853:0:14454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940649.494858:0:14454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520800/0x27a633fcdd4bfaf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.494865:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520800/0x27a633fcdd4bfaf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.494881:0:14454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520e00/0x27a633fcdd4bfb6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.494898:0:14454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520e00/0x27a633fcdd4bfb6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.494904:0:14454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520e00/0x27a633fcdd4bfb6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.494910:0:14454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f181520e00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940649.494913:0:14454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520e00/0x27a633fcdd4bfb6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.494920:0:14454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520e00/0x27a633fcdd4bfb6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.494929:0:14454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff89f186931300) 00010000:00010000:2.0:1788940649.494932:0:14454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940649.494935:0:14454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520e00/0x27a633fcdd4bfb6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.494941:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520e00/0x27a633fcdd4bfb6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.494987:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520000/0x27a633fcdd4bfa8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c2e expref: 8 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.495002:0:14454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521e00/0x27a633fcdd4bfbd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c2e expref: 7 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.495009:0:14454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff89f186931b00) 00010000:00010000:2.0:1788940649.495011:0:14454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788940649.495019:0:14454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f181521e00, rc 0) 00000100:00100000:2.0:1788940649.495087:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f191021c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36f240b4-a296-44d9-a5c6-bed8adad0c38+7:14450:x1875839718380160:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 717us (953us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940649.495094:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 22 00000100:00100000:2.0:1788940649.505361:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940649.505462:0:16687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718380416 00000100:00100000:0.0:1788940649.505472:0:16687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718380416 00000100:00100000:0.0:1788940649.505572:0:16687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 23 00000100:00100000:0.0:1788940649.505583:0:16687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf554e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36f240b4-a296-44d9-a5c6-bed8adad0c38+7:14450:x1875839718380416:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:0.0:1788940649.505620:0:16687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940649.505642:0:16687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb200/0x27a633fcdd4bfc4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5c35 expref: -99 pid: 16687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940649.505734:0:16687:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788940649.505860:0:16687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb200/0x27a633fcdd4bfc4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c35 expref: 9 pid: 16687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.505873:0:16687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f188f81300) 00010000:00010000:0.0:1788940649.505876:0:16687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788940649.505881:0:16687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb200/0x27a633fcdd4bfc4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c35 expref: 9 pid: 16687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.505894:0:16687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f0812eb200, rc 0) 00000100:00100000:0.0:1788940649.505946:0:16687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf554e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36f240b4-a296-44d9-a5c6-bed8adad0c38+8:14450:x1875839718380416:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 365us (594us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1788940649.505953:0:16687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 23 00000100:00100000:0.0:1788940649.515789:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940649.515893:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718380672 00000100:00100000:2.0:1788940649.515904:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718380672 00000100:00100000:2.0:1788940649.515988:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 24 00000100:00100000:2.0:1788940649.516000:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36f240b4-a296-44d9-a5c6-bed8adad0c38+8:14450:x1875839718380672:12345-192.168.202.14@tcp:36:lfs.0 00010000:00010000:2.0:1788940649.516055:0:14454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940649.516081:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521e00/0x27a633fcdd4bfbd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c2e expref: 8 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.516101:0:14454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff89f186931b00) 00010000:00010000:2.0:1788940649.516113:0:14454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788940649.516136:0:14454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520000/0x27a633fcdd4bfd2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.516156:0:14454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520000/0x27a633fcdd4bfd2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.516166:0:14454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520000/0x27a633fcdd4bfd2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788940649.516389:0:14454:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008d70ad7b reply state 000000001653b2e1 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520000/0x27a633fcdd4bfd2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940649.516400:0:14454:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788940649.516407:0:14454:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788940649.516885:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36f240b4-a296-44d9-a5c6-bed8adad0c38+9:14450:x1875839718380672:12345-192.168.202.14@tcp:36:lfs.0 Request processed in 887us (1105us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788940649.516919:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 24 00010000:00010000:3.0:1788940649.524451:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520000/0x27a633fcdd4bfd2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940649.524470:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520000/0x27a633fcdd4bfd2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940649.524478:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520000/0x27a633fcdd4bfd2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940649.524484:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f181520000 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940649.524502:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520000/0x27a633fcdd4bfd2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940649.524511:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520000/0x27a633fcdd4bfd2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940649.524565:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff89f186931300) 00010000:00010000:3.0:1788940649.524569:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1788940649.524575:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520000/0x27a633fcdd4bfd2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940649.524582:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520000/0x27a633fcdd4bfd2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940649.524742:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940649.524815:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718380928 00000100:00100000:1.0:1788940649.524826:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718380928 00000100:00100000:1.0:1788940649.524885:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 2 00000100:00100000:1.0:1788940649.524895:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36f240b4-a296-44d9-a5c6-bed8adad0c38+8:14450:x1875839718380928:12345-192.168.202.14@tcp:35:lfs.0 00000100:00100000:1.0:1788940649.525176:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36f240b4-a296-44d9-a5c6-bed8adad0c38+9:14450:x1875839718380928:12345-192.168.202.14@tcp:35:lfs.0 Request processed in 282us (439us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1788940649.525183:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 2 00000100:00100000:1.0:1788940649.531932:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940649.532094:0:16687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718381184 00000100:00100000:0.0:1788940649.532104:0:16687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718381184 00000100:00100000:0.0:1788940649.532181:0:16687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 25 00000100:00100000:0.0:1788940649.532192:0:16687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4c24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36f240b4-a296-44d9-a5c6-bed8adad0c38+9:14450:x1875839718381184:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:0.0:1788940649.532219:0:16687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940649.532240:0:16687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb200/0x27a633fcdd4bfd9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5c3c expref: -99 pid: 16687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.532337:0:16687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eaa00/0x27a633fcdd4bfe0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.532352:0:16687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eaa00/0x27a633fcdd4bfe0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.532364:0:16687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eaa00/0x27a633fcdd4bfe0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.532378:0:16687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ebe00/0x27a633fcdd4bfe7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.532384:0:16687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ebe00/0x27a633fcdd4bfe7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.532391:0:16687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ebe00/0x27a633fcdd4bfe7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940649.532497:0:16687:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788940649.532632:0:16687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eaa00/0x27a633fcdd4bfe0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.532641:0:16687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eaa00/0x27a633fcdd4bfe0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.532647:0:16687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eaa00/0x27a633fcdd4bfe0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.532653:0:16687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f0812eaa00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:0.0:1788940649.532656:0:16687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eaa00/0x27a633fcdd4bfe0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.532676:0:16687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eaa00/0x27a633fcdd4bfe0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.532689:0:16687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f188f81300) 00010000:00010000:0.0:1788940649.532692:0:16687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940649.532698:0:16687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eaa00/0x27a633fcdd4bfe0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.532703:0:16687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eaa00/0x27a633fcdd4bfe0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.532716:0:16687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ebe00/0x27a633fcdd4bfe7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.532723:0:16687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ebe00/0x27a633fcdd4bfe7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.532728:0:16687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ebe00/0x27a633fcdd4bfe7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.532734:0:16687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f0812ebe00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:0.0:1788940649.532737:0:16687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ebe00/0x27a633fcdd4bfe7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.532743:0:16687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ebe00/0x27a633fcdd4bfe7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.532750:0:16687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff89f185751800) 00010000:00010000:0.0:1788940649.532753:0:16687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940649.532756:0:16687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ebe00/0x27a633fcdd4bfe7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.532772:0:16687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ebe00/0x27a633fcdd4bfe7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.532815:0:16687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb200/0x27a633fcdd4bfd9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c3c expref: 11 pid: 16687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.532825:0:16687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f188f81300) 00010000:00010000:0.0:1788940649.532828:0:16687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788940649.532831:0:16687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb200/0x27a633fcdd4bfd9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c3c expref: 11 pid: 16687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.532841:0:16687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f0812eb200, rc 0) 00000100:00100000:0.0:1788940649.532897:0:16687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4c24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36f240b4-a296-44d9-a5c6-bed8adad0c38+10:14450:x1875839718381184:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 707us (989us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1788940649.532905:0:16687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 25 00000100:00100000:2.0:1788940649.536678:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940649.536777:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718381312 00000100:00100000:1.0:1788940649.536788:0:14456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718381312 00000100:00100000:1.0:1788940649.536850:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 26 00000100:00100000:1.0:1788940649.536861:0:14456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf554a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36f240b4-a296-44d9-a5c6-bed8adad0c38+10:14450:x1875839718381312:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:1.0:1788940649.536885:0:14456:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940649.536909:0:14456:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4bff5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5c43 expref: -99 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940649.537024:0:14456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ca00/0x27a633fcdd4bffc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940649.537039:0:14456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ca00/0x27a633fcdd4bffc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940649.537052:0:14456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ca00/0x27a633fcdd4bffc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940649.537079:0:14456:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788940649.537095:0:14456:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788940649.537116:0:14456:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ca00/0x27a633fcdd4bffc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940649.537302:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4bff5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c43 expref: 12 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940649.537323:0:14456:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ca00/0x27a633fcdd4bffc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c43 expref: 11 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940649.537332:0:14456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff89f188f81900) 00010000:00010000:1.0:1788940649.537335:0:14456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788940649.537339:0:14456:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f19258ca00, rc 0) 00000100:00100000:1.0:1788940649.537446:0:14456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf554a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36f240b4-a296-44d9-a5c6-bed8adad0c38+11:14450:x1875839718381312:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 585us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940649.537454:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 26 00000100:00100000:1.0:1788940649.540823:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940649.540928:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718381440 00000100:00100000:0.0:1788940649.540938:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718381440 00000100:00100000:0.0:1788940649.541009:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 3 00000100:00100000:0.0:1788940649.541020:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4c24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36f240b4-a296-44d9-a5c6-bed8adad0c38+11:14450:x1875839718381440:12345-192.168.202.14@tcp:37:lfs.0 00000100:00100000:1.0:1788940649.546772:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4c24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36f240b4-a296-44d9-a5c6-bed8adad0c38+11:14450:x1875839718381440:12345-192.168.202.14@tcp:37:lfs.0 Request processed in 5741us (5947us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940649.546787:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 3 00000100:00100000:1.0:1788940649.556554:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940649.556644:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718381696 00000100:00100000:3.0:1788940649.556656:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718381696 00000100:00100000:3.0:1788940649.556709:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 4 00000100:00100000:3.0:1788940649.556718:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1aefa6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36f240b4-a296-44d9-a5c6-bed8adad0c38+11:14450:x1875839718381696:12345-192.168.202.14@tcp:35:lfs.0 00000100:00100000:3.0:1788940649.556946:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1aefa6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36f240b4-a296-44d9-a5c6-bed8adad0c38+12:14450:x1875839718381696:12345-192.168.202.14@tcp:35:lfs.0 Request processed in 227us (430us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1788940649.556964:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 4 00000100:00100000:1.0:1788940649.630912:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940649.631000:0:16687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718381824 00000100:00100000:0.0:1788940649.631017:0:16687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718381824 00000100:00100000:0.0:1788940649.631068:0:16687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 27 00000100:00100000:0.0:1788940649.631076:0:16687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4c25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b800dac5-5ff3-48f9-949d-d7448f32aa11+10:14456:x1875839718381824:12345-192.168.202.14@tcp:101:bash.0 00010000:00010000:0.0:1788940649.631096:0:16687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940649.631115:0:16687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eaa00/0x27a633fcdd4c003 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5c4a expref: -99 pid: 16687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.631195:0:16687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eba00/0x27a633fcdd4c00a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.631207:0:16687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eba00/0x27a633fcdd4c00a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.631222:0:16687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eba00/0x27a633fcdd4c00a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.631233:0:16687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb600/0x27a633fcdd4c011 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.631238:0:16687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb600/0x27a633fcdd4c011 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.631242:0:16687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb600/0x27a633fcdd4c011 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.631314:0:16687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ebe00/0x27a633fcdd4c018 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.631319:0:16687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ebe00/0x27a633fcdd4c018 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.631323:0:16687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ebe00/0x27a633fcdd4c018 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940649.631344:0:16687:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788940649.631346:0:16687:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788940649.631374:0:16687:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ebe00/0x27a633fcdd4c018 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.631391:0:16687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eba00/0x27a633fcdd4c00a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.631395:0:16687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eba00/0x27a633fcdd4c00a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.631400:0:16687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eba00/0x27a633fcdd4c00a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.631403:0:16687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f0812eba00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:0.0:1788940649.631406:0:16687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eba00/0x27a633fcdd4c00a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.631411:0:16687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eba00/0x27a633fcdd4c00a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.631418:0:16687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f188f81300) 00010000:00010000:0.0:1788940649.631420:0:16687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940649.631424:0:16687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eba00/0x27a633fcdd4c00a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.631427:0:16687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eba00/0x27a633fcdd4c00a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.631435:0:16687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb600/0x27a633fcdd4c011 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.631439:0:16687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb600/0x27a633fcdd4c011 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.631442:0:16687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb600/0x27a633fcdd4c011 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.631448:0:16687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f0812eb600 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:0.0:1788940649.631450:0:16687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb600/0x27a633fcdd4c011 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.631454:0:16687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb600/0x27a633fcdd4c011 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.631458:0:16687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff89f185751800) 00010000:00010000:0.0:1788940649.631459:0:16687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940649.631460:0:16687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb600/0x27a633fcdd4c011 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.631463:0:16687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb600/0x27a633fcdd4c011 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.631487:0:16687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eaa00/0x27a633fcdd4c003 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c4a expref: 12 pid: 16687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.631499:0:16687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ebe00/0x27a633fcdd4c018 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c4a expref: 11 pid: 16687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.631505:0:16687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff89f188f81900) 00010000:00010000:0.0:1788940649.631506:0:16687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788940649.631508:0:16687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f0812ebe00, rc 0) 00000100:00100000:0.0:1788940649.631612:0:16687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4c25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b800dac5-5ff3-48f9-949d-d7448f32aa11+11:14456:x1875839718381824:12345-192.168.202.14@tcp:101:bash.0 Request processed in 535us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940649.631621:0:16687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 27 00000100:00100000:0.0:1788940649.638458:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940649.638691:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718382080 00000100:00100000:1.0:1788940649.638704:0:14456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718382080 00000100:00100000:1.0:1788940649.638830:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 28 00000100:00100000:1.0:1788940649.638841:0:14456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b800dac5-5ff3-48f9-949d-d7448f32aa11+11:14456:x1875839718382080:12345-192.168.202.14@tcp:101:bash.0 00010000:00010000:1.0:1788940649.638862:0:14456:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940649.638883:0:14456:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4c01f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5c51 expref: -99 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940649.639395:0:14456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4c026 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940649.639485:0:14456:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ca00/0x27a633fcdd4bffc lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c43 expref: 11 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940649.639495:0:14456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4c026 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940649.639576:0:14456:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ca00/0x27a633fcdd4bffc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c43 expref: 11 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940649.639592:0:14456:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ca00/0x27a633fcdd4bffc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c43 expref: 11 pid: 14456 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940649.639607:0:14456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4c25500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14456:1875839738300288:192.168.202.14@tcp:104: 00000100:00100000:1.0:1788940649.639694:0:14456:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1834e3600 going to sleep for 11 seconds 00000100:00100000:3.0:1788940649.643311:0:14456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4c25500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14456:1875839738300288:192.168.202.14@tcp:104: 00010000:00010000:3.0:1788940649.643341:0:14456:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4c026 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940649.646126:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940649.646263:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718382208 00000100:00100000:3.0:1788940649.646273:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718382208 00010000:00010000:3.0:1788940649.646313:0:14441:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ca00/0x27a633fcdd4bffc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c43 expref: 12 pid: 14456 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940649.646433:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 10 00000100:00100000:3.0:1788940649.646444:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36f240b4-a296-44d9-a5c6-bed8adad0c38+12:2352:x1875839718382208:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940649.646458:0:14441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940649.646465:0:14441:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ca00/0x27a633fcdd4bffc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c43 expref: 12 pid: 14456 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940649.646477:0:14441:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ca00/0x27a633fcdd4bffc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c43 expref: 12 pid: 14456 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940649.646496:0:14441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258ca00/0x27a633fcdd4bffc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c43 expref: 12 pid: 14456 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940649.646512:0:14441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff89f188f81900) 00010000:00010000:3.0:1788940649.646516:0:14441:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4c026 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940649.646577:0:14441:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4c026 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940649.646584:0:14441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4c026 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940649.646608:0:14441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940649.646664:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:36f240b4-a296-44d9-a5c6-bed8adad0c38+11:2352:x1875839718382208:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 222us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940649.646671:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 10 00010000:00010000:0.0:1788940649.646741:0:14456:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4c026 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.646749:0:14456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4c026 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.646773:0:14456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb600/0x27a633fcdd4c02d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.646782:0:14456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb600/0x27a633fcdd4c02d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.646789:0:14456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb600/0x27a633fcdd4c02d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.649291:0:14456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eba00/0x27a633fcdd4c034 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.649310:0:14456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eba00/0x27a633fcdd4c034 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.649323:0:14456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eba00/0x27a633fcdd4c034 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940649.649340:0:14456:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788940649.649398:0:14456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4c026 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.649860:0:14456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4c026 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.649870:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4c026 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.649888:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258c000 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:0.0:1788940649.649892:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4c026 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.649911:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4c026 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.651037:0:14456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff89f188f81900) 00010000:00010000:0.0:1788940649.651047:0:14456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940649.651055:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4c026 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.651064:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c000/0x27a633fcdd4c026 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788940649.651084:0:14456:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c9acaaf6 reply state 00000000b6a83fff transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb600/0x27a633fcdd4c02d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940649.651092:0:14456:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788940649.651141:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4c01f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c51 expref: 14 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.651155:0:14456:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eba00/0x27a633fcdd4c034 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c51 expref: 13 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.651162:0:14456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89f185751f00) 00010000:00010000:0.0:1788940649.651164:0:14456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788940649.651177:0:14456:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f0812eba00, rc 0) 00000100:00100000:0.0:1788940649.651261:0:14456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b800dac5-5ff3-48f9-949d-d7448f32aa11+14:14456:x1875839718382080:12345-192.168.202.14@tcp:101:bash.0 Request processed in 12421us (12812us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1788940649.651280:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 28 00010000:00010000:2.0:1788940649.660319:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb600/0x27a633fcdd4c02d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.660333:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb600/0x27a633fcdd4c02d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.660339:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb600/0x27a633fcdd4c02d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.660344:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f0812eb600 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940649.660347:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb600/0x27a633fcdd4c02d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.660352:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb600/0x27a633fcdd4c02d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.660366:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff89f185751800) 00010000:00010000:2.0:1788940649.660368:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940649.660371:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb600/0x27a633fcdd4c02d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.660375:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb600/0x27a633fcdd4c02d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940649.684034:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940649.684120:0:16687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718382336 00000100:00100000:0.0:1788940649.684129:0:16687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718382336 00000100:00100000:0.0:1788940649.684187:0:16687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 29 00000100:00100000:0.0:1788940649.684194:0:16687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf555500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b800dac5-5ff3-48f9-949d-d7448f32aa11+13:14456:x1875839718382336:12345-192.168.202.14@tcp:101:bash.0 00010000:00010000:0.0:1788940649.684219:0:16687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940649.684235:0:16687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb200/0x27a633fcdd4c042 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5c58 expref: -99 pid: 16687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.684288:0:16687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb000/0x27a633fcdd4c049 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.684300:0:16687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb000/0x27a633fcdd4c049 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.684309:0:16687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb000/0x27a633fcdd4c049 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940649.684341:0:16687:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788940649.684344:0:16687:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788940649.684358:0:16687:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb000/0x27a633fcdd4c049 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.684366:0:16687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb000/0x27a633fcdd4c049 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.684382:0:16687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb200/0x27a633fcdd4c042 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c58 expref: 15 pid: 16687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.684394:0:16687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb000/0x27a633fcdd4c049 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c58 expref: 14 pid: 16687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.684414:0:16687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89f185751f00) 00010000:00010000:0.0:1788940649.684418:0:16687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788940649.684422:0:16687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f0812eb000, rc 0) 00000100:00100000:0.0:1788940649.684481:0:16687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf555500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b800dac5-5ff3-48f9-949d-d7448f32aa11+14:14456:x1875839718382336:12345-192.168.202.14@tcp:101:bash.0 Request processed in 287us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940649.684486:0:16687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 29 00000100:00100000:0.0:1788940649.691458:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940649.691749:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718382592 00000100:00100000:3.0:1788940649.691767:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718382592 00000100:00100000:3.0:1788940649.691814:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 5 00000100:00100000:3.0:1788940649.691825:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b800dac5-5ff3-48f9-949d-d7448f32aa11+14:14456:x1875839718382592:12345-192.168.202.14@tcp:35:bash.0 00000100:00100000:3.0:1788940649.692175:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b800dac5-5ff3-48f9-949d-d7448f32aa11+15:14456:x1875839718382592:12345-192.168.202.14@tcp:35:bash.0 Request processed in 352us (726us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1788940649.692181:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 5 00000100:00100000:2.0:1788940649.892048:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940649.893037:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718382848 00000100:00100000:0.0:1788940649.893051:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718382848 00000100:00100000:0.0:1788940649.893124:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 30 00000100:00100000:0.0:1788940649.893135:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ba975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b800dac5-5ff3-48f9-949d-d7448f32aa11+15:14466:x1875839718382848:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:0.0:1788940649.893168:0:14454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940649.893188:0:14454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb200/0x27a633fcdd4c050 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5c5f expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940649.893305:0:14454:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788940649.893451:0:14454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb200/0x27a633fcdd4c050 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c5f expref: 17 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.893465:0:14454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f188f81300) 00010000:00010000:0.0:1788940649.893468:0:14454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788940649.893474:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb200/0x27a633fcdd4c050 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c5f expref: 17 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940649.893489:0:14454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f0812eb200, rc 0) 00000100:00100000:0.0:1788940649.893626:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ba975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b800dac5-5ff3-48f9-949d-d7448f32aa11+16:14466:x1875839718382848:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 492us (1589us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1788940649.893907:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 30 00000100:00100000:2.0:1788940649.905914:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940649.906004:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718383104 00000100:00100000:1.0:1788940649.906015:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718383104 00000100:00100000:1.0:1788940649.906078:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 6 00000100:00100000:1.0:1788940649.906089:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ba975c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b800dac5-5ff3-48f9-949d-d7448f32aa11+16:14466:x1875839718383104:12345-192.168.202.14@tcp:35:lfs.0 00000100:00100000:1.0:1788940649.906329:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ba975c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b800dac5-5ff3-48f9-949d-d7448f32aa11+17:14466:x1875839718383104:12345-192.168.202.14@tcp:35:lfs.0 Request processed in 241us (423us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1788940649.906337:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 6 00000040:00080000:0.0:1788940649.965382:0:14488:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788940650.004775:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940650.005498:0:16687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718383360 00000100:00100000:0.0:1788940650.005511:0:16687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718383360 00000100:00100000:0.0:1788940650.005663:0:16687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 31 00000100:00100000:0.0:1788940650.005675:0:16687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4c25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b800dac5-5ff3-48f9-949d-d7448f32aa11+17:14470:x1875839718383360:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:0.0:1788940650.005707:0:16687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940650.005729:0:16687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb200/0x27a633fcdd4c05e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5c66 expref: -99 pid: 16687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940650.005833:0:16687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea800/0x27a633fcdd4c065 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940650.005850:0:16687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea800/0x27a633fcdd4c065 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940650.005865:0:16687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea800/0x27a633fcdd4c065 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940650.005877:0:16687:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788940650.009093:0:16687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb200/0x27a633fcdd4c05e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c66 expref: 20 pid: 16687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940650.009125:0:16687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea800/0x27a633fcdd4c065 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c66 expref: 19 pid: 16687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940650.009136:0:16687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89f185751f00) 00010000:00010000:0.0:1788940650.009139:0:16687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788940650.009162:0:16687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f0812ea800, rc 0) 00000100:00100000:0.0:1788940650.010066:0:16687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4c25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b800dac5-5ff3-48f9-949d-d7448f32aa11+19:14470:x1875839718383360:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 4387us (5295us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1788940650.010077:0:16687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 31 00000100:00100000:2.0:1788940650.023437:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940650.023509:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940650.023795:0:16687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718383488 00000100:00100000:0.0:1788940650.023807:0:16687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718383488 00000100:00100000:0.0:1788940650.023871:0:16687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 32 00000100:00100000:0.0:1788940650.023891:0:16687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ba975180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b800dac5-5ff3-48f9-949d-d7448f32aa11+19:14470:x1875839718383488:12345-192.168.202.14@tcp:54:lfs.0 00010000:00010000:0.0:1788940650.023963:0:16687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea200/0x27a633fcdd4c073 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940650.023981:0:16687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea200/0x27a633fcdd4c073 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940650.023992:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718383616 00010000:00010000:0.0:1788940650.023994:0:16687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea200/0x27a633fcdd4c073 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940650.024000:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718383616 00010000:00010000:0.0:1788940650.024024:0:16687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea200/0x27a633fcdd4c073 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940650.024033:0:16687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea200/0x27a633fcdd4c073 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940650.024040:0:16687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea200/0x27a633fcdd4c073 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940650.024047:0:16687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f0812ea200 already unused, calling callback (ffffffffc21374f0) 00000100:00100000:3.0:1788940650.024052:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 0 00010000:00010000:0.0:1788940650.024055:0:16687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea200/0x27a633fcdd4c073 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940650.024065:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ba974700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b800dac5-5ff3-48f9-949d-d7448f32aa11+20:2352:x1875839718383616:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940650.024068:0:16687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea200/0x27a633fcdd4c073 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940650.024079:0:14439:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940650.024090:0:16687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89f185751f00) 00010000:00010000:0.0:1788940650.024094:0:16687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788940650.024735:0:16687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea200/0x27a633fcdd4c073 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940650.024746:0:16687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea200/0x27a633fcdd4c073 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940650.024839:0:16687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ba975180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b800dac5-5ff3-48f9-949d-d7448f32aa11+20:14470:x1875839718383488:12345-192.168.202.14@tcp:54:lfs.0 Request processed in 957us (1411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940650.024847:0:16687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 32 00010000:00010000:3.0:1788940650.029974:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea800/0x27a633fcdd4c065 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c66 expref: 19 pid: 16687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940650.030002:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89f185751f00) 00010000:00010000:3.0:1788940650.030007:0:14439:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940650.030479:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ba974700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b800dac5-5ff3-48f9-949d-d7448f32aa11+18:2352:x1875839718383616:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 6414us (6965us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940650.030491:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 0 00000100:00100000:1.0:1788940650.030938:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940650.031059:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718383872 00000100:00100000:2.0:1788940650.031068:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718383872 00000100:00100000:2.0:1788940650.031116:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 7 00000100:00100000:2.0:1788940650.031125:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4c25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b800dac5-5ff3-48f9-949d-d7448f32aa11+18:14470:x1875839718383872:12345-192.168.202.14@tcp:35:lfs.0 00000100:00100000:2.0:1788940650.031333:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4c25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b800dac5-5ff3-48f9-949d-d7448f32aa11+19:14470:x1875839718383872:12345-192.168.202.14@tcp:35:lfs.0 Request processed in 209us (397us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1788940650.031340:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 7 00010000:00010000:3.0:1788940650.157492:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940650.566021:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940650.566275:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718384128 00000100:00100000:3.0:1788940650.566288:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718384128 00000100:00100000:3.0:1788940650.566369:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 33 00000100:00100000:3.0:1788940650.566382:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4c24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b800dac5-5ff3-48f9-949d-d7448f32aa11+19:14501:x1875839718384128:12345-192.168.202.14@tcp:101:cat.0 00010000:00010000:3.0:1788940650.566428:0:14455:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940650.566452:0:14455:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96a00/0x27a633fcdd4c07a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5c6d expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940650.566582:0:14455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96e00/0x27a633fcdd4c081 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940650.566613:0:14455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96e00/0x27a633fcdd4c081 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940650.566626:0:14455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96e00/0x27a633fcdd4c081 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940650.566638:0:14455:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788940650.566789:0:14455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96a00/0x27a633fcdd4c07a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c6d expref: 22 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940650.566810:0:14455:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96e00/0x27a633fcdd4c081 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c6d expref: 21 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940650.566818:0:14455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89f185751f00) 00010000:00010000:3.0:1788940650.566821:0:14455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788940650.566824:0:14455:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f1bfa96e00, rc 0) 00000100:00100000:3.0:1788940650.566911:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4c24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b800dac5-5ff3-48f9-949d-d7448f32aa11+21:14501:x1875839718384128:12345-192.168.202.14@tcp:101:cat.0 Request processed in 522us (892us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1788940650.566918:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 33 00000100:00100000:1.0:1788940650.570986:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940650.571065:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718384256 00000100:00100000:3.0:1788940650.571075:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718384256 00000100:00100000:3.0:1788940650.571154:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 1 00000100:00100000:3.0:1788940650.571165:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4c27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b800dac5-5ff3-48f9-949d-d7448f32aa11+21:2351:x1875839718384256:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940650.571185:0:14441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940650.571210:0:14441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96e00/0x27a633fcdd4c081 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c6d expref: 21 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940650.571249:0:14441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89f185751f00) 00010000:00010000:3.0:1788940650.571255:0:14441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940650.571319:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4c27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b800dac5-5ff3-48f9-949d-d7448f32aa11+20:2351:x1875839718384256:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 156us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940650.571327:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 1 00000100:00100000:0.0:1788940650.571844:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940650.571982:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718384512 00000100:00100000:2.0:1788940650.571989:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718384512 00000100:00100000:2.0:1788940650.572085:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 8 00000100:00100000:2.0:1788940650.572096:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b800dac5-5ff3-48f9-949d-d7448f32aa11+20:14501:x1875839718384512:12345-192.168.202.14@tcp:35:cat.0 00000100:00100000:2.0:1788940650.573851:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b800dac5-5ff3-48f9-949d-d7448f32aa11+21:14501:x1875839718384512:12345-192.168.202.14@tcp:35:cat.0 Request processed in 1750us (2000us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1788940650.573864:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 8 00000100:00100000:0.0:1788940650.715416:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940650.715555:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718384768 00000100:00100000:1.0:1788940650.715566:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718384768 00000100:00100000:1.0:1788940650.715628:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 34 00000100:00100000:1.0:1788940650.715638:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b800dac5-5ff3-48f9-949d-d7448f32aa11+21:14507:x1875839718384768:12345-192.168.202.14@tcp:101:dd.0 00010000:00010000:1.0:1788940650.715664:0:14454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940650.715688:0:14454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4c08f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5c74 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940650.715804:0:14454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4c096 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940650.715819:0:14454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4c096 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940650.715830:0:14454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4c096 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940650.715843:0:14454:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788940650.716257:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4c08f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c74 expref: 24 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940650.716277:0:14454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4c096 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c74 expref: 23 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940650.716284:0:14454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89f185751f00) 00010000:00010000:1.0:1788940650.716287:0:14454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788940650.716291:0:14454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f19258c600, rc 0) 00000100:00100000:1.0:1788940650.716363:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b800dac5-5ff3-48f9-949d-d7448f32aa11+23:14507:x1875839718384768:12345-192.168.202.14@tcp:101:dd.0 Request processed in 727us (958us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1788940650.716385:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 34 00000100:00100000:1.0:1788940650.722206:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940650.725123:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718385024 00000100:00100000:3.0:1788940650.725256:0:14456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718385024 00000100:00100000:3.0:1788940650.725333:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 35 00000100:00100000:3.0:1788940650.725345:0:14456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf580e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b800dac5-5ff3-48f9-949d-d7448f32aa11+23:14507:x1875839718385024:12345-192.168.202.14@tcp:36:dd.0 00010000:00010000:3.0:1788940650.725412:0:14456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788940650.725440:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c600/0x27a633fcdd4c096 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c74 expref: 23 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940650.725474:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb000/0x27a633fcdd4c049 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c58 expref: 22 pid: 16687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940650.725583:0:14456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89f185751f00) 00010000:00010000:3.0:1788940650.725589:0:14456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788940650.725852:0:14456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96e00/0x27a633fcdd4c0a4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940650.725863:0:14456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96e00/0x27a633fcdd4c0a4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940650.725870:0:14456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96e00/0x27a633fcdd4c0a4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788940650.725933:0:14456:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1788940650.725983:0:14456:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000073441097 reply state 000000009a650742 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96e00/0x27a633fcdd4c0a4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940650.725993:0:14456:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788940650.726111:0:14456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf580e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b800dac5-5ff3-48f9-949d-d7448f32aa11+24:14507:x1875839718385024:12345-192.168.202.14@tcp:36:dd.0 Request processed in 767us (3913us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1788940650.726119:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 35 00000020:00080000:3.0:1788940650.726124:0:14456:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788940650.729849:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96e00/0x27a633fcdd4c0a4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940650.729867:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96e00/0x27a633fcdd4c0a4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940650.729875:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96e00/0x27a633fcdd4c0a4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940650.729882:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1bfa96e00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940650.729887:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96e00/0x27a633fcdd4c0a4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940650.729895:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96e00/0x27a633fcdd4c0a4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940650.729911:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89f185751f00) 00010000:00010000:3.0:1788940650.729914:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940650.729920:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96e00/0x27a633fcdd4c0a4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940650.729926:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96e00/0x27a633fcdd4c0a4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940650.864277:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940650.864426:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718385280 00000100:00100000:3.0:1788940650.864437:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718385280 00000100:00100000:3.0:1788940650.864604:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 9 00000100:00100000:3.0:1788940650.864625:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf580700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b800dac5-5ff3-48f9-949d-d7448f32aa11+23:14507:x1875839718385280:12345-192.168.202.14@tcp:35:dd.0 00000100:00100000:3.0:1788940650.865008:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf580700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b800dac5-5ff3-48f9-949d-d7448f32aa11+24:14507:x1875839718385280:12345-192.168.202.14@tcp:35:dd.0 Request processed in 394us (739us total) trans 8589934611 rc 0/0 00000100:00100000:3.0:1788940650.865017:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 9 00010000:00010000:2.0:1788940651.181011:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940651.216714:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940651.217114:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718385408 00000100:00100000:1.0:1788940651.217124:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718385408 00000100:00100000:1.0:1788940651.217240:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 36 00000100:00100000:1.0:1788940651.217253:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ba974e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b800dac5-5ff3-48f9-949d-d7448f32aa11+24:14521:x1875839718385408:12345-192.168.202.14@tcp:101:stat.0 00010000:00010000:1.0:1788940651.217279:0:14454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940651.217302:0:14454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4c0ab lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5c7b expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940651.217369:0:14454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258da00/0x27a633fcdd4c0b2 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940651.217384:0:14454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258da00/0x27a633fcdd4c0b2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940651.217406:0:14454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258da00/0x27a633fcdd4c0b2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940651.217421:0:14454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4c0b9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940651.217429:0:14454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4c0b9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940651.217436:0:14454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4c0b9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940651.217587:0:14454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258cc00/0x27a633fcdd4c0c0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940651.217611:0:14454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258cc00/0x27a633fcdd4c0c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940651.217619:0:14454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258cc00/0x27a633fcdd4c0c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940651.217659:0:14454:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788940651.217664:0:14454:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788940651.217977:0:14454:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258cc00/0x27a633fcdd4c0c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940651.217990:0:14454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258cc00/0x27a633fcdd4c0c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940651.217999:0:14454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258da00/0x27a633fcdd4c0b2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940651.218006:0:14454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258da00/0x27a633fcdd4c0b2 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940651.218013:0:14454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258da00/0x27a633fcdd4c0b2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940651.218019:0:14454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258da00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940651.218023:0:14454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258da00/0x27a633fcdd4c0b2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940651.218031:0:14454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258da00/0x27a633fcdd4c0b2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940651.218042:0:14454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff89f188f81900) 00010000:00010000:1.0:1788940651.218045:0:14454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940651.218059:0:14454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258da00/0x27a633fcdd4c0b2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940651.218066:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258da00/0x27a633fcdd4c0b2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940651.218079:0:14454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4c0b9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940651.218085:0:14454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4c0b9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940651.218090:0:14454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4c0b9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940651.218094:0:14454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258d800 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940651.218097:0:14454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4c0b9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940651.218103:0:14454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4c0b9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940651.218111:0:14454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff89f188f81800) 00010000:00010000:1.0:1788940651.218113:0:14454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940651.218116:0:14454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4c0b9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940651.218121:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4c0b9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940651.218156:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4c0ab lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c7b expref: 26 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940651.218182:0:14454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258cc00/0x27a633fcdd4c0c0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c7b expref: 25 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940651.218189:0:14454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89f185751f00) 00010000:00010000:1.0:1788940651.218191:0:14454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788940651.218193:0:14454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f19258cc00, rc 0) 00000100:00100000:1.0:1788940651.218257:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ba974e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b800dac5-5ff3-48f9-949d-d7448f32aa11+25:14521:x1875839718385408:12345-192.168.202.14@tcp:101:stat.0 Request processed in 1007us (1566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940651.218265:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 36 00000100:00080000:2.0:1788940651.224968:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788940651.316103:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940651.316193:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718385664 00000100:00100000:3.0:1788940651.316204:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718385664 00000100:00100000:3.0:1788940651.316269:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 37 00000100:00100000:3.0:1788940651.316282:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1baad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b800dac5-5ff3-48f9-949d-d7448f32aa11+25:14527:x1875839718385664:12345-192.168.202.14@tcp:36:truncate.0 00010000:00010000:3.0:1788940651.316334:0:14455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940651.316361:0:14455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258cc00/0x27a633fcdd4c0c0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c7b expref: 25 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940651.316378:0:14455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89f185751f00) 00010000:00010000:3.0:1788940651.316383:0:14455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788940651.316648:0:14455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96e00/0x27a633fcdd4c0c7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940651.316664:0:14455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96e00/0x27a633fcdd4c0c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940651.316674:0:14455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96e00/0x27a633fcdd4c0c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788940651.316744:0:14455:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:3.0:1788940651.316786:0:14455:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003d0ca249 reply state 00000000c601ec24 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96e00/0x27a633fcdd4c0c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940651.316794:0:14455:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788940651.316910:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1baad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b800dac5-5ff3-48f9-949d-d7448f32aa11+27:14527:x1875839718385664:12345-192.168.202.14@tcp:36:truncate.0 Request processed in 630us (817us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1788940651.316918:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 37 00000020:00080000:3.0:1788940651.316922:0:14455:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788940651.319847:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96e00/0x27a633fcdd4c0c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940651.319864:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96e00/0x27a633fcdd4c0c7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940651.319872:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96e00/0x27a633fcdd4c0c7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940651.319892:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1bfa96e00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940651.319896:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96e00/0x27a633fcdd4c0c7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940651.319905:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96e00/0x27a633fcdd4c0c7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940651.319921:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89f185751f00) 00010000:00010000:2.0:1788940651.319924:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940651.319929:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96e00/0x27a633fcdd4c0c7 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940651.319936:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96e00/0x27a633fcdd4c0c7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940651.604964:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940651.605053:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718385792 00000100:00100000:1.0:1788940651.605062:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718385792 00000100:00100000:1.0:1788940651.605115:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 38 00000100:00100000:1.0:1788940651.605122:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1baad4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b800dac5-5ff3-48f9-949d-d7448f32aa11+26:14541:x1875839718385792:12345-192.168.202.14@tcp:101:stat.0 00010000:00010000:1.0:1788940651.605144:0:14454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940651.605161:0:14454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4c0ce lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5c82 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940651.605210:0:14454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4c0d5 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940651.605222:0:14454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4c0d5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940651.605230:0:14454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4c0d5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940651.605239:0:14454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258da00/0x27a633fcdd4c0dc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940651.605256:0:14454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258da00/0x27a633fcdd4c0dc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940651.605260:0:14454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258da00/0x27a633fcdd4c0dc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940651.605327:0:14454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4c0e3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940651.605332:0:14454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4c0e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940651.605337:0:14454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4c0e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940651.605366:0:14454:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:1.0:1788940651.605369:0:14454:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788940651.605383:0:14454:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4c0e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940651.605397:0:14454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4c0e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940651.605402:0:14454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4c0d5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940651.605406:0:14454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4c0d5 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940651.605410:0:14454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4c0d5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940651.605421:0:14454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258d800 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940651.605425:0:14454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4c0d5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940651.605431:0:14454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4c0d5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940651.605440:0:14454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff89f188f81900) 00010000:00010000:1.0:1788940651.605442:0:14454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940651.605445:0:14454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4c0d5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940651.605449:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d800/0x27a633fcdd4c0d5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940651.605458:0:14454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258da00/0x27a633fcdd4c0dc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940651.605461:0:14454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258da00/0x27a633fcdd4c0dc lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940651.605465:0:14454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258da00/0x27a633fcdd4c0dc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940651.605468:0:14454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258da00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940651.605469:0:14454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258da00/0x27a633fcdd4c0dc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940651.605473:0:14454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258da00/0x27a633fcdd4c0dc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940651.605483:0:14454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff89f188f81800) 00010000:00010000:1.0:1788940651.605485:0:14454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940651.605488:0:14454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258da00/0x27a633fcdd4c0dc lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940651.605494:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258da00/0x27a633fcdd4c0dc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940651.605579:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4c0ce lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c82 expref: 28 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940651.605594:0:14454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4c0e3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c82 expref: 27 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940651.605602:0:14454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89f185751f00) 00010000:00010000:1.0:1788940651.605604:0:14454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788940651.605614:0:14454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f19258dc00, rc 0) 00000100:00100000:1.0:1788940651.605666:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1baad4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b800dac5-5ff3-48f9-949d-d7448f32aa11+27:14541:x1875839718385792:12345-192.168.202.14@tcp:101:stat.0 Request processed in 545us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940651.605672:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 38 00000100:00100000:3.0:1788940651.818090:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940651.819066:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718386048 00000100:00100000:0.0:1788940651.819083:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718386048 00000100:00100000:0.0:1788940651.819171:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 39 00000100:00100000:0.0:1788940651.819183:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f191023800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b800dac5-5ff3-48f9-949d-d7448f32aa11+27:14551:x1875839718386048:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:0.0:1788940651.819210:0:14455:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940651.819236:0:14455:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eaa00/0x27a633fcdd4c0ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5c89 expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940651.819344:0:14455:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788940651.819559:0:14455:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eaa00/0x27a633fcdd4c0ea lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c89 expref: 29 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940651.819574:0:14455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f188f81300) 00010000:00010000:0.0:1788940651.819823:0:14455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788940651.819830:0:14455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eaa00/0x27a633fcdd4c0ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c89 expref: 29 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940651.819845:0:14455:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f0812eaa00, rc 0) 00000100:00100000:0.0:1788940651.819923:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f191023800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b800dac5-5ff3-48f9-949d-d7448f32aa11+28:14551:x1875839718386048:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 742us (1845us total) trans 8589934614 rc 301/301 00000100:00100000:0.0:1788940651.819930:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 39 00000100:00100000:3.0:1788940651.829031:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940651.829146:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718386304 00000100:00100000:2.0:1788940651.829160:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718386304 00000100:00100000:2.0:1788940651.829231:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 10 00000100:00100000:2.0:1788940651.829242:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1aefa5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b800dac5-5ff3-48f9-949d-d7448f32aa11+28:14551:x1875839718386304:12345-192.168.202.14@tcp:35:lfs.0 00000100:00100000:2.0:1788940651.829557:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1aefa5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b800dac5-5ff3-48f9-949d-d7448f32aa11+29:14551:x1875839718386304:12345-192.168.202.14@tcp:35:lfs.0 Request processed in 315us (543us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1788940651.829565:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 10 00000100:00100000:2.0:1788940651.964892:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940651.965026:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718386560 00000100:00100000:1.0:1788940651.965038:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718386560 00000100:00100000:1.0:1788940651.965103:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 40 00000100:00100000:1.0:1788940651.965115:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ba975c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b800dac5-5ff3-48f9-949d-d7448f32aa11+29:14557:x1875839718386560:12345-192.168.202.14@tcp:101:bash.0 00010000:00010000:1.0:1788940651.965150:0:14454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940651.965173:0:14454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4c0f8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5c90 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940651.965299:0:14454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258da00/0x27a633fcdd4c0ff lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940651.965318:0:14454:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eba00/0x27a633fcdd4c034 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c51 expref: 30 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940651.965327:0:14454:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4c0e3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c82 expref: 30 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940651.965336:0:14454:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258da00/0x27a633fcdd4c0ff lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940651.965373:0:14454:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4c0e3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c82 expref: 30 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940651.965401:0:14454:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4c0e3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c82 expref: 30 pid: 14454 timeout: 694 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940651.965416:0:14454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf580380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14454:1875839738300416:192.168.202.14@tcp:104: 00010000:00010000:1.0:1788940651.965565:0:14454:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eba00/0x27a633fcdd4c034 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c51 expref: 30 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940651.965576:0:14454:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eba00/0x27a633fcdd4c034 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c51 expref: 30 pid: 14456 timeout: 694 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940651.965586:0:14454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf582d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14454:1875839738300544:192.168.202.14@tcp:104: 00000100:00100000:1.0:1788940651.965627:0:14454:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1834e30c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788940651.972251:0:14454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf580380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14454:1875839738300416:192.168.202.14@tcp:104: 00000100:00100000:1.0:1788940651.972270:0:14454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf582d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14454:1875839738300544:192.168.202.14@tcp:104: 00010000:00010000:1.0:1788940651.972299:0:14454:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258da00/0x27a633fcdd4c0ff lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940651.976009:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940651.976058:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940651.976286:0:14440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718386688 00000100:00100000:3.0:1788940651.976296:0:14440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718386688 00010000:00010000:3.0:1788940651.976341:0:14440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4c0e3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c82 expref: 31 pid: 14454 timeout: 694 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940651.976385:0:14440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718386816 00000100:00100000:3.0:1788940651.976398:0:14440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718386816 00010000:00010000:3.0:1788940651.976413:0:14440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eba00/0x27a633fcdd4c034 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c51 expref: 32 pid: 14456 timeout: 694 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940651.976430:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 11 00000100:00100000:3.0:1788940651.976439:0:14440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b709cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b800dac5-5ff3-48f9-949d-d7448f32aa11+32:2352:x1875839718386688:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940651.976453:0:14440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940651.976460:0:14440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4c0e3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c82 expref: 32 pid: 14454 timeout: 694 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940651.976474:0:14440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4c0e3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c82 expref: 32 pid: 14454 timeout: 694 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940651.976516:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258dc00/0x27a633fcdd4c0e3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c82 expref: 32 pid: 14454 timeout: 694 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940651.976559:0:14440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89f185751f00) 00010000:00010000:3.0:1788940651.976564:0:14440:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258da00/0x27a633fcdd4c0ff lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940651.976573:0:14440:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258da00/0x27a633fcdd4c0ff lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940651.976580:0:14440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940651.976640:0:14440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b709cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b800dac5-5ff3-48f9-949d-d7448f32aa11+31:2352:x1875839718386688:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 201us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940651.976648:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 11 00000100:00100000:3.0:1788940651.976708:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 12 00000100:00100000:3.0:1788940651.976716:0:14440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ba977100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b800dac5-5ff3-48f9-949d-d7448f32aa11+30:2352:x1875839718386816:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940651.976724:0:14440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940651.976729:0:14440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eba00/0x27a633fcdd4c034 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c51 expref: 30 pid: 14456 timeout: 694 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940651.976740:0:14440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eba00/0x27a633fcdd4c034 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c51 expref: 30 pid: 14456 timeout: 694 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940651.976752:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eba00/0x27a633fcdd4c034 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c51 expref: 30 pid: 14456 timeout: 694 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940651.976775:0:14440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89f185751f00) 00010000:00010000:3.0:1788940651.976779:0:14440:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258da00/0x27a633fcdd4c0ff lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940651.976787:0:14440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258da00/0x27a633fcdd4c0ff lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940651.976795:0:14440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258da00/0x27a633fcdd4c0ff lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940651.976820:0:14440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940651.976842:0:14440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ba977100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b800dac5-5ff3-48f9-949d-d7448f32aa11+29:2352:x1875839718386816:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 127us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940651.976848:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 12 00010000:00010000:1.0:1788940651.976995:0:14454:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258da00/0x27a633fcdd4c0ff lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940651.977004:0:14454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258da00/0x27a633fcdd4c0ff lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940651.977026:0:14454:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:1.0:1788940651.977207:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4c0f8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c90 expref: 30 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940651.977225:0:14454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258da00/0x27a633fcdd4c0ff lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c90 expref: 29 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940651.977233:0:14454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89f185751f00) 00010000:00010000:1.0:1788940651.977236:0:14454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788940651.977238:0:14454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f19258da00, rc 0) 00000100:00100000:1.0:1788940651.977269:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ba975c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b800dac5-5ff3-48f9-949d-d7448f32aa11+29:14557:x1875839718386560:12345-192.168.202.14@tcp:101:bash.0 Request processed in 12157us (12386us total) trans 8589934616 rc 0/0 00000100:00100000:1.0:1788940651.977276:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 40 00000100:00100000:0.0:1788940651.983372:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940651.983463:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718387072 00000100:00100000:2.0:1788940651.983475:0:14456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718387072 00000100:00100000:2.0:1788940651.983557:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 41 00000100:00100000:2.0:1788940651.983583:0:14456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f083edd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b800dac5-5ff3-48f9-949d-d7448f32aa11+29:14557:x1875839718387072:12345-192.168.202.14@tcp:36:bash.0 00010000:00010000:2.0:1788940651.983871:0:14456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520800/0x27a633fcdd4c10d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940651.983890:0:14456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520800/0x27a633fcdd4c10d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940651.983903:0:14456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520800/0x27a633fcdd4c10d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788940651.983968:0:14456:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:2.0:1788940651.983993:0:14456:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000030cdd96a reply state 00000000d09ae782 transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520800/0x27a633fcdd4c10d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940651.984002:0:14456:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788940651.984100:0:14456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f083edd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b800dac5-5ff3-48f9-949d-d7448f32aa11+32:14557:x1875839718387072:12345-192.168.202.14@tcp:36:bash.0 Request processed in 519us (740us total) trans 8589934618 rc 0/0 00000100:00100000:2.0:1788940651.984108:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 41 00000020:00080000:2.0:1788940651.984113:0:14456:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788940651.988896:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520800/0x27a633fcdd4c10d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940651.988918:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520800/0x27a633fcdd4c10d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940651.988926:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520800/0x27a633fcdd4c10d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940651.988942:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f181520800 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940651.988948:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520800/0x27a633fcdd4c10d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940651.988956:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520800/0x27a633fcdd4c10d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940651.990770:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89f185751f00) 00010000:00010000:3.0:1788940651.990773:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940651.990782:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520800/0x27a633fcdd4c10d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940651.990792:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520800/0x27a633fcdd4c10d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940651.992251:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940651.992356:0:16687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718387200 00000100:00100000:3.0:1788940651.992367:0:16687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718387200 00000100:00100000:3.0:1788940651.992582:0:16687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 42 00000100:00100000:3.0:1788940651.992595:0:16687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f083edc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b800dac5-5ff3-48f9-949d-d7448f32aa11+31:14557:x1875839718387200:12345-192.168.202.14@tcp:101:bash.0 00010000:00010000:3.0:1788940651.992624:0:16687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940651.992645:0:16687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96a00/0x27a633fcdd4c114 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5c97 expref: -99 pid: 16687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940651.992722:0:16687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96a00/0x27a633fcdd4c114 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c97 expref: 32 pid: 16687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940651.992738:0:16687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96a00/0x27a633fcdd4c114 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c97 expref: 32 pid: 16687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940651.992762:0:16687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89f185751f00) 00010000:00010000:3.0:1788940651.992765:0:16687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788940651.992769:0:16687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f1bfa96a00, rc 0) 00000100:00100000:3.0:1788940651.992833:0:16687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f083edc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b800dac5-5ff3-48f9-949d-d7448f32aa11+32:14557:x1875839718387200:12345-192.168.202.14@tcp:101:bash.0 Request processed in 241us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940651.992841:0:16687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 42 00000100:00100000:2.0:1788940652.004059:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940652.004506:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718387328 00000100:00100000:3.0:1788940652.004555:0:14456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718387328 00000100:00100000:3.0:1788940652.004614:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 43 00000100:00100000:3.0:1788940652.004624:0:14456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ba974000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b800dac5-5ff3-48f9-949d-d7448f32aa11+32:14557:x1875839718387328:12345-192.168.202.14@tcp:101:bash.0 00010000:00010000:3.0:1788940652.004645:0:14456:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940652.004667:0:14456:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96c00/0x27a633fcdd4c11b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5c9e expref: -99 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940652.004756:0:14456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96400/0x27a633fcdd4c122 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940652.004771:0:14456:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258da00/0x27a633fcdd4c0ff lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c90 expref: 33 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940652.004779:0:14456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96400/0x27a633fcdd4c122 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940652.004813:0:14456:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258da00/0x27a633fcdd4c0ff lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c90 expref: 33 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940652.004825:0:14456:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258da00/0x27a633fcdd4c0ff lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c90 expref: 33 pid: 14454 timeout: 694 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940652.004838:0:14456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f191020000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14456:1875839738300672:192.168.202.14@tcp:104: 00000100:00100000:3.0:1788940652.005188:0:14456:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1aeec6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788940652.009403:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940652.010021:0:14440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718387456 00000100:00100000:0.0:1788940652.010031:0:14440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718387456 00010000:00010000:0.0:1788940652.010079:0:14440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258da00/0x27a633fcdd4c0ff lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c90 expref: 34 pid: 14454 timeout: 694 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940652.010128:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 13 00000100:00100000:0.0:1788940652.010139:0:14440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ba974700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b800dac5-5ff3-48f9-949d-d7448f32aa11+34:2353:x1875839718387456:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940652.010155:0:14440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940652.010162:0:14440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258da00/0x27a633fcdd4c0ff lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c90 expref: 34 pid: 14454 timeout: 694 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940652.010177:0:14440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258da00/0x27a633fcdd4c0ff lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c90 expref: 34 pid: 14454 timeout: 694 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940652.010201:0:14440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89f185751f00) 00010000:00010000:0.0:1788940652.010207:0:14440:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96400/0x27a633fcdd4c122 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940652.010237:0:14440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96400/0x27a633fcdd4c122 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940652.010245:0:14440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96400/0x27a633fcdd4c122 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940652.010273:0:14440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940652.010333:0:14440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ba974700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b800dac5-5ff3-48f9-949d-d7448f32aa11+34:2353:x1875839718387456:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 196us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940652.010341:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 13 00010000:00010000:3.0:1788940652.011456:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258da00/0x27a633fcdd4c0ff lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c90 expref: 33 pid: 14454 timeout: 694 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940652.011478:0:14456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f191020000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14456:1875839738300672:192.168.202.14@tcp:104: 00010000:00010000:3.0:1788940652.011572:0:14456:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96400/0x27a633fcdd4c122 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940652.011583:0:14456:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96400/0x27a633fcdd4c122 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940652.011590:0:14456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96400/0x27a633fcdd4c122 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940652.011642:0:14456:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788940652.011647:0:14456:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788940652.011670:0:14456:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96400/0x27a633fcdd4c122 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940652.011714:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96c00/0x27a633fcdd4c11b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c9e expref: 33 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940652.011729:0:14456:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96400/0x27a633fcdd4c122 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c9e expref: 32 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940652.011737:0:14456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89f185751f00) 00010000:00010000:3.0:1788940652.011740:0:14456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788940652.011742:0:14456:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f1bfa96400, rc 0) 00000100:00100000:3.0:1788940652.011789:0:14456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ba974000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b800dac5-5ff3-48f9-949d-d7448f32aa11+32:14557:x1875839718387328:12345-192.168.202.14@tcp:101:bash.0 Request processed in 7167us (7741us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940652.011796:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 43 00000100:00100000:2.0:1788940652.019853:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940652.019925:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718387712 00000100:00100000:0.0:1788940652.019944:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718387712 00000100:00100000:0.0:1788940652.020018:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 2 00000100:00100000:0.0:1788940652.020030:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4c24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b800dac5-5ff3-48f9-949d-d7448f32aa11+32:14557:x1875839718387712:12345-192.168.202.14@tcp:103:bash.0 00010000:00010000:0.0:1788940652.020048:0:14441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788940652.020073:0:14441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96400/0x27a633fcdd4c122 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c9e expref: 32 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940652.020092:0:14441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96a00/0x27a633fcdd4c114 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c97 expref: 31 pid: 16687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940652.020102:0:14441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89f185751f00) 00010000:00010000:0.0:1788940652.020114:0:14441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940652.020170:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4c24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b800dac5-5ff3-48f9-949d-d7448f32aa11+30:14557:x1875839718387712:12345-192.168.202.14@tcp:103:bash.0 Request processed in 142us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940652.020178:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 2 00000100:00100000:0.0:1788940652.026950:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940652.027401:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718387840 00000100:00100000:1.0:1788940652.027413:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718387840 00000100:00100000:1.0:1788940652.027489:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 44 00000100:00100000:1.0:1788940652.027508:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f083edf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b800dac5-5ff3-48f9-949d-d7448f32aa11+30:14557:x1875839718387840:12345-192.168.202.14@tcp:58:bash.0 00010000:00010000:1.0:1788940652.027646:0:14454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4c129 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940652.027663:0:14454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4c129 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940652.027677:0:14454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4c129 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940652.030220:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940652.030273:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940652.030305:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940652.030329:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940652.030349:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940652.030371:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940652.030403:0:15139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718388224 00000100:00100000:2.0:1788940652.030413:0:15139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718388224 00000100:00100000:2.0:1788940652.030503:0:15139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718388480 00000100:00100000:2.0:1788940652.030507:0:15139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718388480 00000100:00100000:2.0:1788940652.030555:0:15139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718388096 00000100:00100000:2.0:1788940652.030559:0:15139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718388096 00000100:00100000:2.0:1788940652.030571:0:15139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718388608 00000100:00100000:2.0:1788940652.030573:0:15139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718388608 00000100:00100000:2.0:1788940652.030589:0:15139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 16 00000100:00100000:2.0:1788940652.030599:0:15139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4c27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b800dac5-5ff3-48f9-949d-d7448f32aa11+5:2353:x1875839718388224:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788940652.030681:0:15139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4c27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b800dac5-5ff3-48f9-949d-d7448f32aa11+5:2353:x1875839718388224:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 83us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940652.030688:0:15139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 16 00000100:00100000:2.0:1788940652.030706:0:15139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 17 00000100:00100000:2.0:1788940652.030713:0:15139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4c25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36f240b4-a296-44d9-a5c6-bed8adad0c38+5:2353:x1875839718388480:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788940652.030739:0:15139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4c25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36f240b4-a296-44d9-a5c6-bed8adad0c38+5:2353:x1875839718388480:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 27us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940652.030744:0:15139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 17 00000100:00100000:2.0:1788940652.030755:0:15139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 18 00000100:00100000:2.0:1788940652.030760:0:15139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b800dac5-5ff3-48f9-949d-d7448f32aa11+5:2352:x1875839718388096:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788940652.030783:0:15139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b800dac5-5ff3-48f9-949d-d7448f32aa11+5:2352:x1875839718388096:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 23us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940652.030788:0:15139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 18 00000100:00100000:2.0:1788940652.030798:0:15139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 19 00000100:00100000:2.0:1788940652.030804:0:15139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36f240b4-a296-44d9-a5c6-bed8adad0c38+5:2352:x1875839718388608:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788940652.030825:0:15139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36f240b4-a296-44d9-a5c6-bed8adad0c38+5:2352:x1875839718388608:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 22us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940652.030841:0:15139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 19 00000100:00100000:2.0:1788940652.030864:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718388352 00000100:00100000:2.0:1788940652.030868:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718388352 00000100:00100000:0.0:1788940652.031027:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718387968 00000100:00100000:0.0:1788940652.031033:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718387968 00000100:00100000:0.0:1788940652.031067:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 125 00000100:00100000:0.0:1788940652.031074:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b53ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:584847da-857b-4e92-a9b9-d2025c0d7e63+13:2353:x1875839718387968:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788940652.031104:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b53ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:584847da-857b-4e92-a9b9-d2025c0d7e63+13:2353:x1875839718387968:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 30us (899us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940652.031111:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 125 00000040:00080000:1.0:1788940652.032634:0:14454:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788940652.032816:0:14454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1788940652.032888:0:14454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1788940652.033023:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f083edf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b800dac5-5ff3-48f9-949d-d7448f32aa11+30:14557:x1875839718387840:12345-192.168.202.14@tcp:58:bash.0 Request processed in 5512us (6087us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940652.033034:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 44 00000100:00100000:1.0:1788940652.033065:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 30 00000100:00100000:1.0:1788940652.033076:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bfbeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36f240b4-a296-44d9-a5c6-bed8adad0c38+11:2352:x1875839718388352:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788940652.033119:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bfbeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36f240b4-a296-44d9-a5c6-bed8adad0c38+11:2352:x1875839718388352:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 46us (2768us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940652.033125:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 30 00000100:00080000:3.0:1788940652.033672:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788940652.033682:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788940652.033685:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788940652.040944:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940652.041082:0:16687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718388736 00000100:00100000:3.0:1788940652.041111:0:16687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718388736 00000100:00100000:3.0:1788940652.041221:0:16687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 45 00000100:00100000:3.0:1788940652.041233:0:16687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f083ede300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b800dac5-5ff3-48f9-949d-d7448f32aa11+30:14557:x1875839718388736:12345-192.168.202.14@tcp:101:bash.0 00010000:00010000:3.0:1788940652.041258:0:16687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940652.041282:0:16687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96c00/0x27a633fcdd4c130 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5ca5 expref: -99 pid: 16687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940652.041342:0:16687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4c129 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940652.041353:0:16687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96c00/0x27a633fcdd4c130 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5ca5 expref: 31 pid: 16687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940652.041374:0:16687:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4c129 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940652.041400:0:16687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96c00/0x27a633fcdd4c130 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5ca5 expref: 31 pid: 16687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940652.041415:0:16687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89f188f81800) 00010000:00010000:3.0:1788940652.041418:0:16687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788940652.041422:0:16687:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96c00/0x27a633fcdd4c130 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5ca5 expref: 31 pid: 16687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940652.041431:0:16687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f1bfa96c00, rc 0) 00000100:00100000:3.0:1788940652.041505:0:16687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f083ede300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b800dac5-5ff3-48f9-949d-d7448f32aa11+31:14557:x1875839718388736:12345-192.168.202.14@tcp:101:bash.0 Request processed in 274us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940652.041513:0:16687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 45 00010000:00010000:3.0:1788940652.210833:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788940653.036879:0:14488:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788940653.036901:0:14488:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788940653.036952:0:14488:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788940653.036959:0:14488:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788940653.037089:0:14488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f191020000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14488:1875839738300800:192.168.202.14@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788940653.037189:0:14488:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1aeec6000 going to sleep for 11 seconds 00000100:00100000:1.0:1788940653.037781:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf580380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738301056:0@lo:400:kworker.0 00000100:00100000:1.0:1788940653.037827:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940653.037849:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf583480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875839738301568:0@lo:400:kworker.0 00000100:00100000:1.0:1788940653.037874:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940653.042389:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf582d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3306:1875839738300928:0@lo:400:kworker.0 00000100:00100000:3.0:1788940653.042665:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf582680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875839738301312:0@lo:400:kworker.0 00000100:00100000:0.0:1788940653.042848:0:15139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738301056 00000100:00100000:0.0:1788940653.042856:0:15139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738301056 00000100:00100000:0.0:1788940653.042943:0:15139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788940653.042954:0:15139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf581880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738301056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940653.046171:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940653.046235:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf581180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875839738301440:0@lo:400:kworker.0 00000100:00100000:2.0:1788940653.046642:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940653.046675:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788940653.046974:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf97e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738301824:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788940653.047008:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940653.047087:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738300928 00000100:00100000:2.0:1788940653.047095:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738300928 00000100:00100000:2.0:1788940653.047155:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788940653.047165:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+19:3306:x1875839738300928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940653.047221:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+19:3306:x1875839738300928:12345-0@lo:400:kworker.0 Request processed in 58us (1058us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940653.047229:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788940653.061426:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf582d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3306:1875839738300928:0@lo:400:kworker.0 00000100:00080000:2.0:1788940653.062110:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788940653.062134:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738301568 00000100:00100000:2.0:1788940653.062141:0:14456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738301568 00000100:00080000:2.0:1788940653.062163:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940653.062208:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738301440 00000100:00100000:2.0:1788940653.062212:0:14456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738301440 00000100:00080000:2.0:1788940653.062227:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940653.062256:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788940653.062266:0:14456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf583800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875839738301568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940653.062390:0:14456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf583800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875839738301568:12345-0@lo:400:kworker.0 Request processed in 125us (24513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940653.062398:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788940653.062415:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788940653.062422:0:14456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae853800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875839738301440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940653.062458:0:14456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae853800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875839738301440:12345-0@lo:400:kworker.0 Request processed in 37us (15817us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940653.062465:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788940653.062511:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf581180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875839738301440:0@lo:400:kworker.0 00000100:00100000:2.0:1788940653.062663:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf582a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738301184:0@lo:400:kworker.0 00000100:00100000:3.0:1788940653.065000:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940653.065061:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738301312 00000100:00100000:3.0:1788940653.065070:0:14456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738301312 00000100:00100000:3.0:1788940653.065116:0:16687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788940653.065126:0:16687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f191023b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875839738301312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940653.065181:0:16687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f191023b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875839738301312:12345-0@lo:400:kworker.0 Request processed in 58us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940653.065188:0:16687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788940653.065227:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf582680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875839738301312:0@lo:400:kworker.0 00000100:00100000:3.0:1788940653.065299:0:15143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738301824 00000100:00100000:3.0:1788940653.065303:0:15143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738301824 00000100:00100000:3.0:1788940653.065330:0:15143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788940653.065336:0:15143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae850380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875839738301824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788940653.065364:0:15143:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788940653.065400:0:15143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae850380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875839738301824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (18392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940653.065406:0:15143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788940653.065436:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf97e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738301824:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788940653.068266:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940653.068323:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940653.068362:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f083edd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738301696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788940653.068397:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940653.068463:0:14488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f191020000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14488:1875839738300800:192.168.202.14@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788940653.068561:0:15140:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788940653.068572:0:15140:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1788940653.070320:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718388864 00000100:00100000:2.0:1788940653.070335:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718388864 00000100:00100000:0.0:1788940653.070450:0:15142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738301696 00000100:00100000:0.0:1788940653.070456:0:15142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738301696 00000100:00080000:3.0:1788940653.072412:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788940653.072424:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788940653.075386:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 0 00000100:00100000:3.0:1788940653.075412:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae852d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:b800dac5-5ff3-48f9-949d-d7448f32aa11+31:14558:x1875839718388864:12345-192.168.202.14@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788940653.075752:0:15142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788940653.075765:0:15142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae851180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738301696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788940653.075796:0:15142:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788940653.075863:0:15142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae851180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738301696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (7463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940653.075870:0:15142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788940653.075956:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f083edd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738301696:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788940653.076005:0:15139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf581880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738301056:12345-0@lo:400:kworker.0 Request processed in 33054us (38178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940653.076014:0:15139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788940653.076028:0:15139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738301184 00000100:00100000:0.0:1788940653.076034:0:15139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738301184 00000100:00100000:0.0:1788940653.076085:0:15141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788940653.076093:0:15141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae852680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738301184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940653.076131:0:15141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae852680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738301184:12345-0@lo:400:kworker.0 Request processed in 39us (7808us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940653.076137:0:15141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788940653.076162:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf582a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738301184:0@lo:400:kworker.0 00000100:00100000:1.0:1788940653.076704:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf583480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875839738301568:0@lo:400:kworker.0 00000100:00100000:1.0:1788940653.076728:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf580380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738301056:0@lo:400:kworker.0 00000100:00100000:3.0:1788940653.077152:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae852d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:b800dac5-5ff3-48f9-949d-d7448f32aa11+31:14558:x1875839718388864:12345-192.168.202.14@tcp:900:lhsmtool_posix.0 Request processed in 1747us (8908us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940653.077161:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 0 00000100:00100000:2.0:1788940653.082151:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940653.082340:0:16687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718388992 00000100:00100000:3.0:1788940653.082350:0:16687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718388992 00000100:00100000:3.0:1788940653.082514:0:16687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 46 00000100:00100000:3.0:1788940653.082559:0:16687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae853100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b800dac5-5ff3-48f9-949d-d7448f32aa11+31:14558:x1875839718388992:12345-192.168.202.14@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788940653.082596:0:16687:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788940653.082873:0:16687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae853100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b800dac5-5ff3-48f9-949d-d7448f32aa11+31:14558:x1875839718388992:12345-192.168.202.14@tcp:53:lhsmtool_posix.0 Request processed in 316us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940653.082889:0:16687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 46 00000100:00100000:3.0:1788940653.088094:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940653.088860:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718389120 00000100:00100000:2.0:1788940653.088872:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718389120 00000100:00100000:2.0:1788940653.088963:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 47 00000100:00100000:2.0:1788940653.088975:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f191022300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b800dac5-5ff3-48f9-949d-d7448f32aa11+31:14558:x1875839718389120:12345-192.168.202.14@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788940653.089055:0:14455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520800/0x27a633fcdd4c137 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.089097:0:14455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520800/0x27a633fcdd4c137 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.089111:0:14455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520800/0x27a633fcdd4c137 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.089128:0:14455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520c00/0x27a633fcdd4c13e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.089136:0:14455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520c00/0x27a633fcdd4c13e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.089143:0:14455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520c00/0x27a633fcdd4c13e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.089165:0:14455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521400/0x27a633fcdd4c145 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.089174:0:14455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521400/0x27a633fcdd4c145 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.089181:0:14455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521400/0x27a633fcdd4c145 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940653.089218:0:14455:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788940653.089223:0:14455:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788940653.089236:0:14455:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521400/0x27a633fcdd4c145 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.089662:0:14455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520800/0x27a633fcdd4c137 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.089692:0:14455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520800/0x27a633fcdd4c137 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.089699:0:14455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520800/0x27a633fcdd4c137 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.089705:0:14455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f181520800 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940653.089710:0:14455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520800/0x27a633fcdd4c137 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.089716:0:14455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520800/0x27a633fcdd4c137 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.089729:0:14455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89f188f81400) 00010000:00010000:2.0:1788940653.089732:0:14455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940653.089737:0:14455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520800/0x27a633fcdd4c137 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.089743:0:14455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520800/0x27a633fcdd4c137 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.089758:0:14455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520c00/0x27a633fcdd4c13e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.089764:0:14455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520c00/0x27a633fcdd4c13e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.089770:0:14455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520c00/0x27a633fcdd4c13e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.089776:0:14455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f181520c00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940653.089785:0:14455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520c00/0x27a633fcdd4c13e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.089792:0:14455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520c00/0x27a633fcdd4c13e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.089800:0:14455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff89f186931b00) 00010000:00010000:2.0:1788940653.089802:0:14455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940653.089805:0:14455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520c00/0x27a633fcdd4c13e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.089811:0:14455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520c00/0x27a633fcdd4c13e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.089827:0:14455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521400/0x27a633fcdd4c145 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.089833:0:14455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521400/0x27a633fcdd4c145 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.089838:0:14455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521400/0x27a633fcdd4c145 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.089843:0:14455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f181521400 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940653.089847:0:14455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521400/0x27a633fcdd4c145 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.089852:0:14455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521400/0x27a633fcdd4c145 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.089859:0:14455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89f188f81800) 00010000:00010000:2.0:1788940653.089862:0:14455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940653.089872:0:14455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521400/0x27a633fcdd4c145 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.089878:0:14455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521400/0x27a633fcdd4c145 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940653.090305:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f191022300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b800dac5-5ff3-48f9-949d-d7448f32aa11+31:14558:x1875839718389120:12345-192.168.202.14@tcp:34:lhsmtool_posix.0 Request processed in 1328us (2217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940653.090314:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 47 00000100:00100000:0.0:1788940653.097682:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940653.097782:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718389376 00000100:00100000:2.0:1788940653.097793:0:14456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718389376 00000100:00100000:2.0:1788940653.097851:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 48 00000100:00100000:2.0:1788940653.097862:0:14456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf97d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b800dac5-5ff3-48f9-949d-d7448f32aa11+31:14558:x1875839718389376:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788940653.097895:0:14456:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940653.097917:0:14456:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521400/0x27a633fcdd4c14c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5cac expref: -99 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.098031:0:14456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520c00/0x27a633fcdd4c153 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.098046:0:14456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520c00/0x27a633fcdd4c153 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.098058:0:14456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520c00/0x27a633fcdd4c153 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940653.098069:0:14456:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788940653.098170:0:14456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520c00/0x27a633fcdd4c153 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.098178:0:14456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520c00/0x27a633fcdd4c153 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.098185:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520c00/0x27a633fcdd4c153 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.098211:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f181520c00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940653.098215:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520c00/0x27a633fcdd4c153 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.098222:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520c00/0x27a633fcdd4c153 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.098235:0:14456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89f188f81800) 00010000:00010000:2.0:1788940653.098238:0:14456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788940653.098242:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520c00/0x27a633fcdd4c153 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.098248:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520c00/0x27a633fcdd4c153 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.098292:0:14456:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521400/0x27a633fcdd4c14c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5cac expref: 33 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.098303:0:14456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89f188f81400) 00010000:00010000:2.0:1788940653.098304:0:14456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788940653.098309:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521400/0x27a633fcdd4c14c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5cac expref: 33 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.098320:0:14456:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f181521400, rc 0) 00000100:00100000:2.0:1788940653.098578:0:14456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf97d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b800dac5-5ff3-48f9-949d-d7448f32aa11+32:14558:x1875839718389376:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 716us (904us total) trans 8589934619 rc 301/301 00000100:00100000:2.0:1788940653.098586:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 48 00000100:00100000:2.0:1788940653.102311:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940653.102434:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718389504 00000100:00100000:1.0:1788940653.102446:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718389504 00000100:00100000:1.0:1788940653.102555:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 49 00000100:00100000:1.0:1788940653.102567:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae850700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b800dac5-5ff3-48f9-949d-d7448f32aa11+32:14558:x1875839718389504:12345-192.168.202.14@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788940653.102603:0:14454:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788940653.102703:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae850700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b800dac5-5ff3-48f9-949d-d7448f32aa11+32:14558:x1875839718389504:12345-192.168.202.14@tcp:53:lhsmtool_posix.0 Request processed in 138us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940653.102711:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 49 00000100:00100000:0.0:1788940653.109115:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940653.109389:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718389760 00000100:00100000:2.0:1788940653.109401:0:14456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718389760 00000100:00100000:2.0:1788940653.109459:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 50 00000100:00100000:2.0:1788940653.109468:0:14456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf97ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b800dac5-5ff3-48f9-949d-d7448f32aa11+32:14558:x1875839718389760:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788940653.109488:0:14456:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940653.109509:0:14456:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521400/0x27a633fcdd4c161 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5cb3 expref: -99 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788940653.113757:0:14456:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x6:0x0], count =28 00000004:00080000:0.0:1788940653.113769:0:14456:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x6:0x0]+28 in llog 00000004:00080000:0.0:1788940653.113865:0:14456:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:0.0:1788940653.114310:0:14456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb200/0x27a633fcdd4c168 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940653.114327:0:14456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb200/0x27a633fcdd4c168 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940653.114341:0:14456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb200/0x27a633fcdd4c168 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940653.114859:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521400/0x27a633fcdd4c161 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5cb3 expref: 35 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940653.114881:0:14456:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb200/0x27a633fcdd4c168 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5cb3 expref: 34 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940653.115019:0:14456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff89f185751f00) 00010000:00010000:0.0:1788940653.115022:0:14456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788940653.115034:0:14456:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f0812eb200, rc 0) 00000100:00100000:0.0:1788940653.115141:0:14456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf97ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b800dac5-5ff3-48f9-949d-d7448f32aa11+34:14558:x1875839718389760:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 5672us (6034us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1788940653.115150:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 50 00000100:00100000:1.0:1788940653.143289:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940653.143373:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718390016 00000100:00100000:2.0:1788940653.143395:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718390016 00000100:00100000:2.0:1788940653.143465:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 51 00000100:00100000:2.0:1788940653.143477:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf580380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b800dac5-5ff3-48f9-949d-d7448f32aa11+34:14558:x1875839718390016:12345-192.168.202.14@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788940653.143569:0:14454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940653.143600:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb200/0x27a633fcdd4c168 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5cb3 expref: 34 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.143631:0:14454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff89f185751f00) 00010000:00010000:2.0:1788940653.143645:0:14454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788940653.143668:0:14454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520800/0x27a633fcdd4c176 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.143690:0:14454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520800/0x27a633fcdd4c176 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.143701:0:14454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520800/0x27a633fcdd4c176 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.143716:0:14454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521400/0x27a633fcdd4c17d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x53622057 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.143741:0:14454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521400/0x27a633fcdd4c17d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x53622057 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.143748:0:14454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521400/0x27a633fcdd4c17d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x53622057 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.143806:0:14454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520800/0x27a633fcdd4c176 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.143813:0:14454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520800/0x27a633fcdd4c176 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.143819:0:14454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520800/0x27a633fcdd4c176 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.143825:0:14454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f181520800 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940653.143829:0:14454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520800/0x27a633fcdd4c176 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.143836:0:14454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520800/0x27a633fcdd4c176 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.143844:0:14454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff89f188f81900) 00010000:00010000:2.0:1788940653.143847:0:14454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940653.143850:0:14454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520800/0x27a633fcdd4c176 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.143857:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520800/0x27a633fcdd4c176 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.143865:0:14454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521400/0x27a633fcdd4c17d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x53622057 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.143877:0:14454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521400/0x27a633fcdd4c17d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x53622057 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.143893:0:14454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521400/0x27a633fcdd4c17d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x53622057 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.143898:0:14454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f181521400 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940653.143901:0:14454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521400/0x27a633fcdd4c17d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x53622057 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.143907:0:14454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521400/0x27a633fcdd4c17d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x53622057 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.143914:0:14454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x53622057 (ffff89f186931b00) 00010000:00010000:2.0:1788940653.143916:0:14454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940653.143919:0:14454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521400/0x27a633fcdd4c17d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x53622057 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.143935:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521400/0x27a633fcdd4c17d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x53622057 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940653.144293:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf580380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b800dac5-5ff3-48f9-949d-d7448f32aa11+33:14558:x1875839718390016:12345-192.168.202.14@tcp:36:lhsmtool_posix.0 Request processed in 817us (1014us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788940653.144301:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 51 00000100:00100000:2.0:1788940653.148003:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940653.148185:0:16687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718390144 00000100:00100000:3.0:1788940653.148196:0:16687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718390144 00000100:00100000:3.0:1788940653.148267:0:16687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 52 00000100:00100000:3.0:1788940653.148278:0:16687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae850e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b800dac5-5ff3-48f9-949d-d7448f32aa11+33:14558:x1875839718390144:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788940653.148298:0:16687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940653.148335:0:16687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97a00/0x27a633fcdd4c184 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5cba expref: -99 pid: 16687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940653.148384:0:16687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97600/0x27a633fcdd4c18b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940653.148398:0:16687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97600/0x27a633fcdd4c18b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940653.148410:0:16687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97600/0x27a633fcdd4c18b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940653.148512:0:16687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97a00/0x27a633fcdd4c184 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5cba expref: 35 pid: 16687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940653.148562:0:16687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97600/0x27a633fcdd4c18b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5cba expref: 34 pid: 16687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940653.148571:0:16687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff89f18a6ce600) 00010000:00010000:3.0:1788940653.148574:0:16687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788940653.148579:0:16687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f1bfa97600, rc 0) 00000100:00100000:3.0:1788940653.148652:0:16687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae850e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b800dac5-5ff3-48f9-949d-d7448f32aa11+34:14558:x1875839718390144:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 375us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940653.148659:0:16687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 52 00000100:00100000:0.0:1788940653.158314:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940653.158483:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718390400 00000100:00100000:2.0:1788940653.158495:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718390400 00000100:00100000:2.0:1788940653.158591:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 53 00000100:00100000:2.0:1788940653.158603:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf97ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b800dac5-5ff3-48f9-949d-d7448f32aa11+34:14558:x1875839718390400:12345-192.168.202.14@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788940653.159121:0:14454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521400/0x27a633fcdd4c192 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.159143:0:14454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521400/0x27a633fcdd4c192 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.159156:0:14454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521400/0x27a633fcdd4c192 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788940653.165310:0:14454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:2.0:1788940653.165334:0:14454:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 596063815310ns, next at 597063811302ns, rc = 0 00000004:00010000:2.0:1788940653.165463:0:14454:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000084689354 reply state 00000000d0364746 transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521400/0x27a633fcdd4c192 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940653.165477:0:14454:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788940653.165649:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf97ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b800dac5-5ff3-48f9-949d-d7448f32aa11+36:14558:x1875839718390400:12345-192.168.202.14@tcp:36:lhsmtool_posix.0 Request processed in 7045us (7340us total) trans 8589934621 rc 0/0 00000100:00100000:2.0:1788940653.165658:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 53 00010000:00010000:1.0:1788940653.173271:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521400/0x27a633fcdd4c192 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940653.173293:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521400/0x27a633fcdd4c192 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940653.173302:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521400/0x27a633fcdd4c192 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940653.173311:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f181521400 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940653.173316:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521400/0x27a633fcdd4c192 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940653.173325:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521400/0x27a633fcdd4c192 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940653.173345:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff89f18a6ce600) 00010000:00010000:1.0:1788940653.173348:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788940653.173353:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521400/0x27a633fcdd4c192 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940653.173382:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521400/0x27a633fcdd4c192 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940653.176959:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940653.177187:0:16687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718390528 00000100:00100000:3.0:1788940653.177198:0:16687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718390528 00000100:00100000:3.0:1788940653.177253:0:16687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 54 00000100:00100000:3.0:1788940653.177263:0:16687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf97e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b800dac5-5ff3-48f9-949d-d7448f32aa11+35:14558:x1875839718390528:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788940653.177293:0:16687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940653.177326:0:16687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97a00/0x27a633fcdd4c199 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5cc1 expref: -99 pid: 16687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940653.177399:0:16687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97a00/0x27a633fcdd4c199 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5cc1 expref: 36 pid: 16687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940653.177414:0:16687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97a00/0x27a633fcdd4c199 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5cc1 expref: 36 pid: 16687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940653.177434:0:16687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff89f18a6ce600) 00010000:00010000:3.0:1788940653.177437:0:16687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788940653.177441:0:16687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f1bfa97a00, rc 0) 00000100:00100000:3.0:1788940653.177514:0:16687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf97e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b800dac5-5ff3-48f9-949d-d7448f32aa11+36:14558:x1875839718390528:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 252us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940653.177550:0:16687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 54 00000100:00100000:2.0:1788940653.192178:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940653.195900:0:15141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718390656 00000100:00100000:0.0:1788940653.195918:0:15141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718390656 00000100:00100000:0.0:1788940653.196015:0:15141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 13 00000100:00100000:0.0:1788940653.196026:0:15141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae850000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b800dac5-5ff3-48f9-949d-d7448f32aa11+5:2353:x1875839718390656:12345-192.168.202.14@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788940653.196425:0:15141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae850000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b800dac5-5ff3-48f9-949d-d7448f32aa11+6:2353:x1875839718390656:12345-192.168.202.14@tcp:2:lhsmtool_posix.0 Request processed in 399us (4257us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788940653.196434:0:15141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 13 00000100:00100000:2.0:1788940653.204708:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940653.204868:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718390912 00000100:00100000:1.0:1788940653.204880:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718390912 00000100:00100000:1.0:1788940653.204953:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 11 00000100:00100000:1.0:1788940653.204966:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae851f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b800dac5-5ff3-48f9-949d-d7448f32aa11+36:14558:x1875839718390912:12345-192.168.202.14@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788940653.205213:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae851f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b800dac5-5ff3-48f9-949d-d7448f32aa11+37:14558:x1875839718390912:12345-192.168.202.14@tcp:35:lhsmtool_posix.0 Request processed in 249us (515us total) trans 8589934622 rc 0/0 00000100:00100000:1.0:1788940653.205220:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 11 00000100:00100000:3.0:1788940653.211087:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940653.212399:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718391168 00000100:00100000:0.0:1788940653.212417:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718391168 00000100:00100000:2.0:1788940653.212610:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 55 00000100:00100000:2.0:1788940653.212622:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f191022680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b800dac5-5ff3-48f9-949d-d7448f32aa11+37:14558:x1875839718391168:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788940653.212769:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f191022680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b800dac5-5ff3-48f9-949d-d7448f32aa11+37:14558:x1875839718391168:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 Request processed in 149us (1691us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940653.212777:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 55 00000100:00100000:2.0:1788940653.217159:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940653.217257:0:16687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718391296 00000100:00100000:3.0:1788940653.217269:0:16687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718391296 00000100:00100000:3.0:1788940653.217333:0:16687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 56 00000100:00100000:3.0:1788940653.217345:0:16687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae850a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b800dac5-5ff3-48f9-949d-d7448f32aa11+37:14558:x1875839718391296:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788940653.217365:0:16687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940653.217398:0:16687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96a00/0x27a633fcdd4c1a0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5cc8 expref: -99 pid: 16687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.220261:0:16687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96400/0x27a633fcdd4c1a7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.220307:0:16687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96400/0x27a633fcdd4c1a7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.220323:0:16687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96400/0x27a633fcdd4c1a7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940653.220441:0:16687:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788940653.220466:0:16687:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96400/0x27a633fcdd4c1a7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.220645:0:16687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96a00/0x27a633fcdd4c1a0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5cc8 expref: 39 pid: 16687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.220668:0:16687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96400/0x27a633fcdd4c1a7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5cc8 expref: 38 pid: 16687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.220677:0:16687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff89f18a6ce600) 00010000:00010000:2.0:1788940653.220910:0:16687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788940653.220916:0:16687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f1bfa96400, rc 0) 00000100:00100000:2.0:1788940653.221122:0:16687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae850a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b800dac5-5ff3-48f9-949d-d7448f32aa11+38:14558:x1875839718391296:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 3778us (3971us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940653.221132:0:16687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 56 00010000:00010000:0.0:1788940653.229306:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940653.229472:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940653.229879:0:15140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718391424 00000100:00100000:0.0:1788940653.229890:0:15140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718391424 00000100:00100000:0.0:1788940653.229998:0:15140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 14 00000100:00100000:0.0:1788940653.230010:0:15140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae853480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b800dac5-5ff3-48f9-949d-d7448f32aa11+6:2352:x1875839718391424:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788940653.230028:0:15140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940653.230050:0:15140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4cd1703/0x27a633fcdd4c1ae lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5ccf expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788940653.230076:0:15140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa1116e, blocks: 0x1 00010000:00010000:0.0:1788940653.230097:0:15140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=596s v=(0 0) 00010000:00010000:0.0:1788940653.230101:0:15140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940653.230128:0:15140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4cd1703/0x27a633fcdd4c1ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5ccf expref: 7 pid: 15140 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940653.230149:0:15140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b4cd1703/0x27a633fcdd4c1ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5ccf expref: 7 pid: 15140 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940653.230164:0:15140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f0812ea200, rc 0) 00000100:00100000:0.0:1788940653.230227:0:15140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae853480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b800dac5-5ff3-48f9-949d-d7448f32aa11+7:2352:x1875839718391424:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 219us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940653.230235:0:15140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 14 00000100:00100000:1.0:1788940653.233948:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940653.234228:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718391680 00000100:00100000:3.0:1788940653.234239:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718391680 00000100:00100000:3.0:1788940653.234294:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 57 00000100:00100000:3.0:1788940653.234304:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf583480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b800dac5-5ff3-48f9-949d-d7448f32aa11+38:14558:x1875839718391680:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788940653.234440:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf583480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b800dac5-5ff3-48f9-949d-d7448f32aa11+38:14558:x1875839718391680:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 Request processed in 137us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940653.234447:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 57 00000100:00100000:1.0:1788940653.239323:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940653.239510:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718391808 00000100:00100000:0.0:1788940653.239551:0:14456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718391808 00000100:00100000:0.0:1788940653.239623:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 58 00000100:00100000:0.0:1788940653.239633:0:14456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf583100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b800dac5-5ff3-48f9-949d-d7448f32aa11+38:14558:x1875839718391808:12345-192.168.202.14@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788940653.284999:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934620 is committed 00000001:00080000:3.0:1788940653.285024:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:3.0:1788940653.285129:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000004:00080000:3.0:1788940653.285249:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:3.0:1788940653.285575:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae852a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738301952:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788940653.285657:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940653.285863:0:15141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738301952 00000100:00100000:2.0:1788940653.285872:0:15141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738301952 00000100:00100000:2.0:1788940653.285938:0:15141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788940653.285948:0:15141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f191020380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738301952:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788940653.286119:0:15141:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788940653.286135:0:15141:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1788940653.286137:0:15141:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788940653.286139:0:15141:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788940654 -> 1788940654 00002000:00010000:2.0:1788940653.286142:0:15141:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788940653.286191:0:15141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f191020380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1875839738301952:12345-0@lo:2:osp-syn-1-0.0 Request processed in 245us (534us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1788940653.286198:0:15141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:3.0:1788940653.286358:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89f1ae852a00/2, rc 0, transno 8589934595 00000100:00100000:3.0:1788940653.286364:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae852a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738301952:0@lo:2:osp-syn-1-0.0 00000001:00080000:3.0:1788940653.286790:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:0.0:1788940653.287073:0:14456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf583100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b800dac5-5ff3-48f9-949d-d7448f32aa11+13:14558:x1875839718391808:12345-192.168.202.14@tcp:44:lhsmtool_posix.0 Request processed in 47438us (47755us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940653.287082:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 58 00000100:00100000:3.0:1788940653.290229:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940653.290356:0:16690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718391936 00000100:00100000:2.0:1788940653.290366:0:16690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718391936 00000100:00100000:2.0:1788940653.290547:0:16690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 16 00000100:00100000:2.0:1788940653.290557:0:16690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f191021500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b800dac5-5ff3-48f9-949d-d7448f32aa11+7:2353:x1875839718391936:12345-192.168.202.14@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788940653.290801:0:16690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f191021500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b800dac5-5ff3-48f9-949d-d7448f32aa11+7:2353:x1875839718391936:12345-192.168.202.14@tcp:16:lhsmtool_posix.0 Request processed in 130us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940653.290809:0:16690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 16 00000100:00100000:1.0:1788940653.293345:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940653.293431:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718392192 00000100:00100000:3.0:1788940653.293440:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718392192 00000100:00100000:3.0:1788940653.293501:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 59 00000100:00100000:3.0:1788940653.293510:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf581500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b800dac5-5ff3-48f9-949d-d7448f32aa11+13:14558:x1875839718392192:12345-192.168.202.14@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788940653.293592:0:14455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940653.293630:0:14455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96400/0x27a633fcdd4c1a7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5cc8 expref: 13 pid: 16687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940653.293650:0:14455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff89f18a6ce600) 00010000:00010000:3.0:1788940653.293655:0:14455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788940653.293699:0:14455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96e00/0x27a633fcdd4c1b5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940653.293712:0:14455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96e00/0x27a633fcdd4c1b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940653.293736:0:14455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96e00/0x27a633fcdd4c1b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788940653.294000:0:14455:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d88a736c reply state 000000007b451058 transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96e00/0x27a633fcdd4c1b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940653.294010:0:14455:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788940653.294102:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf581500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b800dac5-5ff3-48f9-949d-d7448f32aa11+14:14558:x1875839718392192:12345-192.168.202.14@tcp:36:lhsmtool_posix.0 Request processed in 592us (766us total) trans 8589934623 rc 0/0 00000100:00100000:3.0:1788940653.294109:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 59 00000100:00100000:1.0:1788940653.297281:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940653.297785:0:15141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718392320 00000100:00100000:0.0:1788940653.297795:0:15141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718392320 00000100:00100000:0.0:1788940653.297848:0:15141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 17 00000100:00100000:0.0:1788940653.297857:0:15141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf581c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b800dac5-5ff3-48f9-949d-d7448f32aa11+7:14558:x1875839718392320:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788940653.297874:0:15141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940653.297891:0:15141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011e8ed91/0x27a633fcdd4c1bc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5cd6 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940653.297930:0:15141:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b4cd1703/0x27a633fcdd4c1ae lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5ccf expref: 8 pid: 15140 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940653.297953:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940653.297957:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940653.297964:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011e8ed91/0x27a633fcdd4c1bc lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5cd6 expref: 8 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940653.297998:0:15141:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b4cd1703/0x27a633fcdd4c1ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5ccf expref: 8 pid: 15140 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940653.298012:0:15141:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b4cd1703/0x27a633fcdd4c1ae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5ccf expref: 8 pid: 15140 timeout: 696 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940653.298026:0:15141:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf97ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15141:1875839738302080:192.168.202.14@tcp:104: 00000100:00100000:0.0:1788940653.298107:0:15141:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1863fa540 going to sleep for 11 seconds 00010000:00010000:3.0:1788940653.298360:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96e00/0x27a633fcdd4c1b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940653.298370:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96e00/0x27a633fcdd4c1b5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940653.298376:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96e00/0x27a633fcdd4c1b5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940653.298389:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1bfa96e00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940653.298394:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96e00/0x27a633fcdd4c1b5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940653.298403:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96e00/0x27a633fcdd4c1b5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940653.298418:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff89f18a6ce600) 00010000:00010000:3.0:1788940653.298421:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940653.298427:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96e00/0x27a633fcdd4c1b5 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940653.298444:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96e00/0x27a633fcdd4c1b5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940653.302014:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940653.302563:0:15141:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf97ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15141:1875839738302080:192.168.202.14@tcp:104: 00010000:00010000:0.0:1788940653.302601:0:15141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000011e8ed91/0x27a633fcdd4c1bc lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5cd6 expref: 8 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940653.302633:0:15141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f0812eb000, rc 0) 00000100:00100000:0.0:1788940653.302708:0:15141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf581c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b800dac5-5ff3-48f9-949d-d7448f32aa11+8:14558:x1875839718392320:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 4850us (5432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940653.302718:0:15141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 17 00000100:00100000:1.0:1788940653.304429:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718392448 00000100:00100000:1.0:1788940653.304441:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718392448 00010000:00010000:1.0:1788940653.304675:0:14439:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b4cd1703/0x27a633fcdd4c1ae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5ccf expref: 8 pid: 15140 timeout: 696 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940653.304806:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 14 00000100:00100000:1.0:1788940653.304817:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f191020e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b800dac5-5ff3-48f9-949d-d7448f32aa11+8:2353:x1875839718392448:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788940653.304831:0:14439:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940653.304854:0:14439:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b4cd1703/0x27a633fcdd4c1ae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5ccf expref: 8 pid: 15140 timeout: 696 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940653.304887:0:14439:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b4cd1703/0x27a633fcdd4c1ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5ccf expref: 8 pid: 15140 timeout: 696 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940653.304910:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4cd1703/0x27a633fcdd4c1ae lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5ccf expref: 8 pid: 15140 timeout: 696 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940653.304935:0:14439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940653.304940:0:14439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940653.304947:0:14439:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000011e8ed91/0x27a633fcdd4c1bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5cd6 expref: 7 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940653.304958:0:14439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011e8ed91/0x27a633fcdd4c1bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5cd6 expref: 7 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940653.304999:0:14439:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000011e8ed91/0x27a633fcdd4c1bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5cd6 expref: 7 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940653.305013:0:14439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf582300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14439:1875839738302208:192.168.202.14@tcp:105: 00000100:00100000:1.0:1788940653.305099:0:14439:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f186823780 going to sleep for 11 seconds 00000100:00100000:1.0:1788940653.308511:0:14439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf582300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14439:1875839738302208:192.168.202.14@tcp:105: 00010000:00010000:1.0:1788940653.308583:0:14439:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940653.308654:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f191020e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b800dac5-5ff3-48f9-949d-d7448f32aa11+7:2353:x1875839718392448:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 3838us (6648us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940653.308692:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 14 00000100:00100000:2.0:1788940653.311842:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940653.312034:0:15140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718392576 00000100:00100000:0.0:1788940653.312045:0:15140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718392576 00000100:00100000:0.0:1788940653.312121:0:15140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 18 00000100:00100000:0.0:1788940653.312132:0:15140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae851500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b800dac5-5ff3-48f9-949d-d7448f32aa11+7:2353:x1875839718392576:12345-192.168.202.14@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788940653.312330:0:15140:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788940653.312334:0:15140:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788940653 00002000:00010000:0.0:1788940653.312337:0:15140:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788940650 00002000:00010000:0.0:1788940653.312339:0:15140:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788940654 -> 1788940653 00002000:00010000:0.0:1788940653.312342:0:15140:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788940653.312418:0:15140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae851500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b800dac5-5ff3-48f9-949d-d7448f32aa11+8:2353:x1875839718392576:12345-192.168.202.14@tcp:2:lhsmtool_posix.0 Request processed in 287us (584us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788940653.312426:0:15140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 18 00000100:00100000:3.0:1788940653.315575:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940653.315916:0:15141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718392704 00000100:00100000:2.0:1788940653.315943:0:15141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718392704 00000100:00100000:2.0:1788940653.316008:0:15141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 19 00000100:00100000:2.0:1788940653.316019:0:15141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f191022a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b800dac5-5ff3-48f9-949d-d7448f32aa11+8:2352:x1875839718392704:12345-192.168.202.14@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788940653.316063:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f0fd90c5/0x27a633fcdd4c1c3 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.316084:0:15141:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000011e8ed91/0x27a633fcdd4c1bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5cd6 expref: 8 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.316093:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940653.316111:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788940653.316117:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0fd90c5/0x27a633fcdd4c1c3 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.316153:0:15141:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000011e8ed91/0x27a633fcdd4c1bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5cd6 expref: 8 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.316168:0:15141:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000011e8ed91/0x27a633fcdd4c1bc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5cd6 expref: 8 pid: 15141 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940653.316182:0:15141:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae851880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15141:1875839738302336:192.168.202.14@tcp:104: 00000100:00100000:2.0:1788940653.316262:0:15141:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f18a75cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788940653.322466:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940653.322582:0:14440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718392832 00000100:00100000:3.0:1788940653.322591:0:14440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718392832 00010000:00010000:3.0:1788940653.322636:0:14440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000011e8ed91/0x27a633fcdd4c1bc lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5cd6 expref: 9 pid: 15141 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940653.322676:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 15 00000100:00100000:3.0:1788940653.322691:0:14440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae852300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b800dac5-5ff3-48f9-949d-d7448f32aa11+9:2352:x1875839718392832:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940653.322704:0:14440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940653.322726:0:14440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000011e8ed91/0x27a633fcdd4c1bc lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5cd6 expref: 9 pid: 15141 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940653.322740:0:14440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000011e8ed91/0x27a633fcdd4c1bc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5cd6 expref: 9 pid: 15141 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940653.322763:0:14440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788940653.322767:0:14440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788940653.322773:0:14440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f0fd90c5/0x27a633fcdd4c1c3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940653.322783:0:14440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0fd90c5/0x27a633fcdd4c1c3 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940653.322819:0:14440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940653.322873:0:14440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae852300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b800dac5-5ff3-48f9-949d-d7448f32aa11+9:2352:x1875839718392832:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 188us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940653.322881:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 15 00010000:00010000:0.0:1788940653.324801:0:15141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011e8ed91/0x27a633fcdd4c1bc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5cd6 expref: 8 pid: 15141 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940653.324826:0:15141:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae851880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15141:1875839738302336:192.168.202.14@tcp:104: 00010000:00010000:0.0:1788940653.324851:0:15141:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f0fd90c5/0x27a633fcdd4c1c3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940653.324958:0:15141:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f0fd90c5/0x27a633fcdd4c1c3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940653.324968:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0fd90c5/0x27a633fcdd4c1c3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940653.325002:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f0fd90c5/0x27a633fcdd4c1c3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940653.325011:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f0fd90c5/0x27a633fcdd4c1c3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940653.325018:0:15141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f0fd90c5/0x27a633fcdd4c1c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940653.325025:0:15141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f181520000 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:1.0:1788940653.325028:0:15141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0fd90c5/0x27a633fcdd4c1c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940653.325038:0:15141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0fd90c5/0x27a633fcdd4c1c3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940653.325055:0:15141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f0fd90c5/0x27a633fcdd4c1c3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940653.325083:0:15141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0fd90c5/0x27a633fcdd4c1c3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940653.325224:0:15141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f191022a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b800dac5-5ff3-48f9-949d-d7448f32aa11+7:2352:x1875839718392704:12345-192.168.202.14@tcp:1:lhsmtool_posix.0 Request processed in 9206us (9657us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940653.325234:0:15141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 19 00000100:00100000:2.0:1788940653.328366:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940653.328612:0:16687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718393088 00000100:00100000:0.0:1788940653.328622:0:16687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718393088 00000100:00100000:0.0:1788940653.328778:0:16687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 60 00000100:00100000:0.0:1788940653.328790:0:16687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae853b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b800dac5-5ff3-48f9-949d-d7448f32aa11+13:14558:x1875839718393088:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788940653.328870:0:16687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb600/0x27a633fcdd4c1ca lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940653.328887:0:16687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb600/0x27a633fcdd4c1ca lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940653.328915:0:16687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb600/0x27a633fcdd4c1ca lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940653.329170:0:16687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eaa00/0x27a633fcdd4c1d1 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940653.329182:0:16687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97a00/0x27a633fcdd4c199 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5cc1 expref: 14 pid: 16687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940653.329190:0:16687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eaa00/0x27a633fcdd4c1d1 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940653.329221:0:16687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97a00/0x27a633fcdd4c199 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5cc1 expref: 14 pid: 16687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940653.329234:0:16687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97a00/0x27a633fcdd4c199 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5cc1 expref: 14 pid: 16687 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940653.329248:0:16687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf97ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16687:1875839738302464:192.168.202.14@tcp:104: 00000100:00100000:0.0:1788940653.329391:0:16687:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f0812bccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788940653.332198:0:16687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf97ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16687:1875839738302464:192.168.202.14@tcp:104: 00010000:00010000:1.0:1788940653.332227:0:16687:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eaa00/0x27a633fcdd4c1d1 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940653.334714:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940653.334806:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718393216 00000100:00100000:1.0:1788940653.334817:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718393216 00010000:00010000:1.0:1788940653.334859:0:14439:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97a00/0x27a633fcdd4c199 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5cc1 expref: 15 pid: 16687 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940653.334895:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 16 00000100:00100000:1.0:1788940653.334905:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae851c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b800dac5-5ff3-48f9-949d-d7448f32aa11+15:2352:x1875839718393216:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788940653.334930:0:14439:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940653.334937:0:14439:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97a00/0x27a633fcdd4c199 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5cc1 expref: 15 pid: 16687 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940653.334951:0:14439:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97a00/0x27a633fcdd4c199 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5cc1 expref: 15 pid: 16687 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940653.334972:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97a00/0x27a633fcdd4c199 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5cc1 expref: 15 pid: 16687 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940653.335003:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff89f18a6ce600) 00010000:00010000:1.0:1788940653.335010:0:14439:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eaa00/0x27a633fcdd4c1d1 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940653.335019:0:14439:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eaa00/0x27a633fcdd4c1d1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940653.335028:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eaa00/0x27a633fcdd4c1d1 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940653.335065:0:14439:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940653.335126:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae851c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b800dac5-5ff3-48f9-949d-d7448f32aa11+14:2352:x1875839718393216:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 222us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940653.335134:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 16 00010000:00010000:0.0:1788940653.335204:0:16687:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eaa00/0x27a633fcdd4c1d1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940653.335213:0:16687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eaa00/0x27a633fcdd4c1d1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788940653.335413:0:16687:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:0.0:1788940653.335597:0:16687:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:0.0:1788940653.335645:0:16687:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:0.0:1788940653.335737:0:16687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf97f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16687:1875839738302592:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788940653.335787:0:16687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940653.335816:0:16687:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f0812bccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788940653.336232:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738302592 00000100:00100000:1.0:1788940653.336238:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738302592 00000100:00100000:1.0:1788940653.336279:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788940653.336288:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf97fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16687:x1875839738302592:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788940653.336386:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf97fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16687:x1875839738302592:12345-0@lo:1000:mdt00_003.0 Request processed in 99us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940653.336393:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788940653.337034:0:16687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf97f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16687:1875839738302592:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1788940653.337725:0:16687:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:0.0:1788940653.337798:0:16687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf97f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16687:1875839738302720:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788940653.337848:0:16687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940653.337877:0:16687:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f0812bc900 going to sleep for 11 seconds 00000100:00100000:1.0:1788940653.338081:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738302720 00000100:00100000:1.0:1788940653.338088:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738302720 00000100:00100000:1.0:1788940653.338133:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788940653.338143:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf97d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16687:x1875839738302720:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788940653.338298:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf97d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:16687:x1875839738302720:12345-0@lo:1000:mdt00_003.0 Request processed in 156us (449us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1788940653.338315:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788940653.338416:0:16687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf97f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16687:1875839738302720:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1788940653.338451:0:16687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eaa00/0x27a633fcdd4c1d1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.338461:0:16687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eaa00/0x27a633fcdd4c1d1 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.338468:0:16687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eaa00/0x27a633fcdd4c1d1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.338474:0:16687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f0812eaa00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940653.338479:0:16687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eaa00/0x27a633fcdd4c1d1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.338497:0:16687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eaa00/0x27a633fcdd4c1d1 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.338513:0:16687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff89f18a6ce600) 00010000:00010000:2.0:1788940653.338543:0:16687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788940653.338550:0:16687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eaa00/0x27a633fcdd4c1d1 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.338557:0:16687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eaa00/0x27a633fcdd4c1d1 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.338588:0:16687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4c129 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.338595:0:16687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4c129 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.338601:0:16687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4c129 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.338606:0:16687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258c200 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940653.338609:0:16687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4c129 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.338615:0:16687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4c129 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.338623:0:16687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89f188f81800) 00010000:00010000:2.0:1788940653.338625:0:16687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788940653.338633:0:16687:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96c00/0x27a633fcdd4c130 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5ca5 expref: 17 pid: 16687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.338655:0:16687:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96c00/0x27a633fcdd4c130 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5ca5 expref: 17 pid: 16687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.338665:0:16687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96c00/0x27a633fcdd4c130 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5ca5 expref: 17 pid: 16687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.338706:0:16687:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96c00/0x27a633fcdd4c130 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5ca5 expref: 17 pid: 16687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940653.338718:0:16687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae851880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16687:1875839738302848:192.168.202.14@tcp:105: 00000100:00100000:2.0:1788940653.338787:0:16687:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f18a75cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788940653.344433:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940653.344509:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718393344 00000100:00100000:3.0:1788940653.344551:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718393344 00000100:00100000:3.0:1788940653.344596:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 12 00000100:00100000:3.0:1788940653.344606:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b800dac5-5ff3-48f9-949d-d7448f32aa11+18:14557:x1875839718393344:12345-192.168.202.14@tcp:49:bash.0 00000100:00100000:3.0:1788940653.344751:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b800dac5-5ff3-48f9-949d-d7448f32aa11+18:14557:x1875839718393344:12345-192.168.202.14@tcp:49:bash.0 Request processed in 146us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940653.344759:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 12 00000100:00100000:0.0:1788940653.344935:0:16687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae851880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16687:1875839738302848:192.168.202.14@tcp:105: 00010000:00010000:0.0:1788940653.344964:0:16687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4c129 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940653.344975:0:16687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258c200/0x27a633fcdd4c129 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940653.345006:0:16687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb000/0x27a633fcdd4c1d8 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940653.345019:0:16687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb000/0x27a633fcdd4c1d8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940653.345030:0:16687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb000/0x27a633fcdd4c1d8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940653.345039:0:16687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb000/0x27a633fcdd4c1d8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940653.345044:0:16687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb000/0x27a633fcdd4c1d8 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940653.345051:0:16687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb000/0x27a633fcdd4c1d8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940653.345070:0:16687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f0812eb000 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:0.0:1788940653.345074:0:16687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb000/0x27a633fcdd4c1d8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940653.345081:0:16687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb000/0x27a633fcdd4c1d8 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940653.345092:0:16687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89f188f81800) 00010000:00010000:0.0:1788940653.345094:0:16687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940653.345098:0:16687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb000/0x27a633fcdd4c1d8 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940653.345103:0:16687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb000/0x27a633fcdd4c1d8 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940653.345113:0:16687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb600/0x27a633fcdd4c1ca lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940653.345118:0:16687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb600/0x27a633fcdd4c1ca lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940653.345123:0:16687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb600/0x27a633fcdd4c1ca lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940653.345128:0:16687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f0812eb600 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:0.0:1788940653.345130:0:16687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb600/0x27a633fcdd4c1ca lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940653.345136:0:16687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb600/0x27a633fcdd4c1ca lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940653.345153:0:16687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89f188f81800) 00010000:00010000:0.0:1788940653.345155:0:16687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788940653.345158:0:16687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb600/0x27a633fcdd4c1ca lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940653.345163:0:16687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb600/0x27a633fcdd4c1ca lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16687 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940653.345364:0:16687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae853b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b800dac5-5ff3-48f9-949d-d7448f32aa11+17:14558:x1875839718393088:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 Request processed in 16575us (17006us total) trans 8589934628 rc 0/0 00000100:00100000:0.0:1788940653.345372:0:16687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 60 00000020:00080000:0.0:1788940653.345375:0:16687:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788940653.345845:0:14488:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788940653.345851:0:14488:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788940653.345875:0:14488:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788940653.345881:0:14488:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788940653.348429:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940653.348556:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718393600 00000100:00100000:2.0:1788940653.348565:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718393600 00000100:00100000:2.0:1788940653.348612:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 13 00000100:00100000:2.0:1788940653.348622:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f191021180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b800dac5-5ff3-48f9-949d-d7448f32aa11+17:14558:x1875839718393600:12345-192.168.202.14@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788940653.349287:0:14458:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788940653.349394:0:14458:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:2.0:1788940653.349440:0:14458:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520c00/0x27a633fcdd4c1df lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.349457:0:14458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520c00/0x27a633fcdd4c1df lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.349469:0:14458:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520c00/0x27a633fcdd4c1df lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.349489:0:14458:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520c00/0x27a633fcdd4c1df lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.349495:0:14458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520c00/0x27a633fcdd4c1df lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.349501:0:14458:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520c00/0x27a633fcdd4c1df lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940653.349552:0:14458:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788940653.349640:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f191021180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b800dac5-5ff3-48f9-949d-d7448f32aa11+19:14558:x1875839718393600:12345-192.168.202.14@tcp:35:lhsmtool_posix.0 Request processed in 1018us (1220us total) trans 8589934630 rc 0/0 00000100:00100000:2.0:1788940653.349648:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 13 00000020:00080000:2.0:1788940653.349653:0:14458:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788940653.350130:0:14442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940653.350138:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520c00/0x27a633fcdd4c1df lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940653.350146:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f181520c00 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:3.0:1788940653.350150:0:14442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520c00/0x27a633fcdd4c1df lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940653.350160:0:14442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520c00/0x27a633fcdd4c1df lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940653.350184:0:14442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff89f18a6ce600) 00010000:00010000:3.0:1788940653.350187:0:14442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788940653.350192:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520c00/0x27a633fcdd4c1df lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940653.350198:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f181520c00/0x27a633fcdd4c1df lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940653.350211:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940653.350213:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940653.350214:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940653.353101:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940653.353174:0:15140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718393728 00000100:00100000:0.0:1788940653.353184:0:15140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718393728 00000100:00100000:0.0:1788940653.353245:0:15140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 20 00000100:00100000:0.0:1788940653.353256:0:15140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4cd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b800dac5-5ff3-48f9-949d-d7448f32aa11+7:14557:x1875839718393728:12345-192.168.202.14@tcp:101:bash.0 00010000:00010000:0.0:1788940653.353275:0:15140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940653.353298:0:15140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a7d605f/0x27a633fcdd4c1e6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5cdd expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788940653.353324:0:15140:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6aa1116d, atime: 0x6aa1116a, ctime: 0x6aa1116d, blocks: 0x1 00010000:00010000:0.0:1788940653.353346:0:15140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=596s v=(0 0) 00010000:00010000:0.0:1788940653.353352:0:15140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940653.353362:0:15140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a7d605f/0x27a633fcdd4c1e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5cdd expref: 8 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940653.353391:0:15140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002a7d605f/0x27a633fcdd4c1e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5cdd expref: 8 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940653.353421:0:15140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f0812eaa00, rc 0) 00000100:00100000:0.0:1788940653.353496:0:15140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4cd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b800dac5-5ff3-48f9-949d-d7448f32aa11+8:14557:x1875839718393728:12345-192.168.202.14@tcp:101:bash.0 Request processed in 242us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940653.353502:0:15140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 20 00000100:00100000:0.0:1788940653.357884:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940653.358022:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718393984 00000100:00100000:2.0:1788940653.358032:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718393984 00000100:00100000:2.0:1788940653.358090:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 14 00000100:00100000:2.0:1788940653.358101:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf97d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b800dac5-5ff3-48f9-949d-d7448f32aa11+19:14557:x1875839718393984:12345-192.168.202.14@tcp:35:bash.0 00000001:00080000:2.0:1788940653.358351:0:14458:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000001:00080000:2.0:1788940653.358466:0:14458:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00000100:00100000:2.0:1788940653.358615:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf97d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b800dac5-5ff3-48f9-949d-d7448f32aa11+22:14557:x1875839718393984:12345-192.168.202.14@tcp:35:bash.0 Request processed in 515us (740us total) trans 8589934633 rc 0/0 00000100:00100000:2.0:1788940653.358623:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 14 00000020:00080000:2.0:1788940653.358628:0:14458:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1788940653.491451:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940653.491544:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718394240 00000100:00100000:3.0:1788940653.491554:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718394240 00000100:00100000:3.0:1788940653.491615:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 61 00000100:00100000:3.0:1788940653.491626:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4cd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b800dac5-5ff3-48f9-949d-d7448f32aa11+22:14568:x1875839718394240:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:3.0:1788940653.491651:0:14455:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940653.491670:0:14455:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96e00/0x27a633fcdd4c1ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5ce4 expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940653.491775:0:14455:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788940653.491887:0:14455:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96e00/0x27a633fcdd4c1ed lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5ce4 expref: 24 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940653.491902:0:14455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f188f81300) 00010000:00010000:3.0:1788940653.491905:0:14455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788940653.491911:0:14455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96e00/0x27a633fcdd4c1ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5ce4 expref: 24 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940653.491956:0:14455:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f1bfa96e00, rc 0) 00000100:00100000:3.0:1788940653.492021:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4cd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b800dac5-5ff3-48f9-949d-d7448f32aa11+23:14568:x1875839718394240:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 396us (581us total) trans 8589934634 rc 301/301 00000100:00100000:3.0:1788940653.492029:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 61 00000100:00100000:3.0:1788940653.500645:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940653.500845:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718394368 00000100:00100000:0.0:1788940653.500856:0:14456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718394368 00000100:00100000:0.0:1788940653.500927:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 62 00000100:00100000:0.0:1788940653.500938:0:14456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f191023100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b800dac5-5ff3-48f9-949d-d7448f32aa11+23:14568:x1875839718394368:12345-192.168.202.14@tcp:34:lfs.0 00010000:00010000:0.0:1788940653.501020:0:14456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb000/0x27a633fcdd4c1fb lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940653.501038:0:14456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb000/0x27a633fcdd4c1fb lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940653.501052:0:14456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb000/0x27a633fcdd4c1fb lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940653.501068:0:14456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea200/0x27a633fcdd4c202 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940653.501075:0:14456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea200/0x27a633fcdd4c202 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940653.501081:0:14456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea200/0x27a633fcdd4c202 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940653.501315:0:14456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea800/0x27a633fcdd4c209 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940653.501330:0:14456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea800/0x27a633fcdd4c209 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940653.501336:0:14456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea800/0x27a633fcdd4c209 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788940653.501375:0:14456:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea800/0x27a633fcdd4c209 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940653.501387:0:14456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb000/0x27a633fcdd4c1fb lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940653.501393:0:14456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb000/0x27a633fcdd4c1fb lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940653.501400:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb000/0x27a633fcdd4c1fb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940653.501405:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f0812eb000 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:0.0:1788940653.501409:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb000/0x27a633fcdd4c1fb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940653.501416:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb000/0x27a633fcdd4c1fb lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940653.501426:0:14456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff89f188f81900) 00010000:00010000:0.0:1788940653.501429:0:14456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940653.501434:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb000/0x27a633fcdd4c1fb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940653.501441:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eb000/0x27a633fcdd4c1fb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940653.501459:0:14456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea200/0x27a633fcdd4c202 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940653.501464:0:14456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea200/0x27a633fcdd4c202 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940653.501470:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea200/0x27a633fcdd4c202 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940653.501474:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f0812ea200 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:0.0:1788940653.501477:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea200/0x27a633fcdd4c202 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940653.501496:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea200/0x27a633fcdd4c202 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940653.501504:0:14456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff89f185751500) 00010000:00010000:0.0:1788940653.501506:0:14456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940653.501509:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea200/0x27a633fcdd4c202 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940653.501514:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea200/0x27a633fcdd4c202 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940653.501579:0:14456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea800/0x27a633fcdd4c209 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940653.501584:0:14456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea800/0x27a633fcdd4c209 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940653.501589:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea800/0x27a633fcdd4c209 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940653.501599:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f0812ea800 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:0.0:1788940653.501601:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea800/0x27a633fcdd4c209 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940653.501607:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea800/0x27a633fcdd4c209 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940653.501614:0:14456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89f188f81800) 00010000:00010000:0.0:1788940653.501616:0:14456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940653.501620:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea800/0x27a633fcdd4c209 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940653.501625:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea800/0x27a633fcdd4c209 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940653.501716:0:14456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f191023100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b800dac5-5ff3-48f9-949d-d7448f32aa11+23:14568:x1875839718394368:12345-192.168.202.14@tcp:34:lfs.0 Request processed in 779us (1079us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940653.501725:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 62 00000100:00100000:0.0:1788940653.506033:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940653.506110:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718394624 00000100:00100000:2.0:1788940653.506121:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718394624 00000100:00100000:2.0:1788940653.506185:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 15 00000100:00100000:2.0:1788940653.506195:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf97f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b800dac5-5ff3-48f9-949d-d7448f32aa11+23:14568:x1875839718394624:12345-192.168.202.14@tcp:35:lfs.0 00000100:00100000:2.0:1788940653.506425:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf97f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b800dac5-5ff3-48f9-949d-d7448f32aa11+24:14568:x1875839718394624:12345-192.168.202.14@tcp:35:lfs.0 Request processed in 231us (400us total) trans 8589934635 rc 0/0 00000100:00100000:2.0:1788940653.506433:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 15 00010000:00010000:0.0:1788940654.252759:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940655.276708:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788940655.607892:0:16729:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00000100:00100000:3.0:1788940656.119775:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940656.119829:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940656.119946:0:16690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718394880 00000100:00100000:0.0:1788940656.119958:0:16690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718394880 00000100:00100000:0.0:1788940656.120031:0:16690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 21 00000100:00100000:0.0:1788940656.120043:0:16690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f191020a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b800dac5-5ff3-48f9-949d-d7448f32aa11+8:2353:x1875839718394880:12345-192.168.202.14@tcp:16:kworker.0 00000100:00100000:0.0:1788940656.120179:0:16690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f191020a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b800dac5-5ff3-48f9-949d-d7448f32aa11+8:2353:x1875839718394880:12345-192.168.202.14@tcp:16:kworker.0 Request processed in 138us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940656.120187:0:16690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 21 00000100:00080000:3.0:1788940656.120842:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788940656.121013:0:15144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718394752 00000100:00100000:2.0:1788940656.121020:0:15144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718394752 00002000:00100000:2.0:1788940656.121049:0:15144:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (0->8) req@ffff89f191020700 x1875839718394752/t0(0) o4->b800dac5-5ff3-48f9-949d-d7448f32aa11@192.168.202.14@tcp:632/0 lens 504/0 e 0 to 0 dl 1788940667 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1788940656.121060:0:15144:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89f191020700 with x1875839718394752 ext(0->8) 00002000:00010000:2.0:1788940656.121067:0:15144:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89f191020700 00000100:00100000:2.0:1788940656.121096:0:15144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 0 00000100:00100000:2.0:1788940656.121104:0:15144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f191020700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b800dac5-5ff3-48f9-949d-d7448f32aa11+8:2353:x1875839718394752:12345-192.168.202.14@tcp:4:bash.0 00000100:00100000:2.0:1788940656.121801:0:15144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f191020700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b800dac5-5ff3-48f9-949d-d7448f32aa11+10:2353:x1875839718394752:12345-192.168.202.14@tcp:4:bash.0 Request processed in 695us (2035us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1788940656.121810:0:15144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 0 00002000:00100000:2.0:1788940656.121818:0:15144:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (0->8) req@ffff89f191020700 x1875839718394752/t8589934598(0) o4->b800dac5-5ff3-48f9-949d-d7448f32aa11@192.168.202.14@tcp:632/0 lens 504/448 e 0 to 0 dl 1788940667 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1788940656.121828:0:15144:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89f191020700 with x1875839718394752 ext(0->8) 00002000:00010000:2.0:1788940656.121832:0:15144:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89f191020700 00010000:00010000:0.0:1788940656.300791:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940657.144847:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940657.144907:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940657.144927:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718395008 00000100:00100000:3.0:1788940657.144948:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718395136 00000100:00100000:1.0:1788940657.144949:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718395008 00000100:00100000:3.0:1788940657.144962:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718395136 00000100:00100000:1.0:1788940657.145039:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 127 00000100:00100000:3.0:1788940657.145049:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 34 00000100:00100000:1.0:1788940657.145063:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:584847da-857b-4e92-a9b9-d2025c0d7e63+13:2351:x1875839718395008:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788940657.145069:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f191022d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b800dac5-5ff3-48f9-949d-d7448f32aa11+24:2351:x1875839718395136:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788940657.145173:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:584847da-857b-4e92-a9b9-d2025c0d7e63+13:2351:x1875839718395008:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 114us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940657.145182:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 127 00000100:00100000:3.0:1788940657.146059:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f191022d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b800dac5-5ff3-48f9-949d-d7448f32aa11+24:2351:x1875839718395136:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 992us (1144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940657.146073:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 34 00000100:00080000:3.0:1788940657.146211:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788940657.153974:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940657.154027:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940657.154058:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940657.154086:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940657.154112:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940657.154177:0:15140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718395392 00000100:00100000:3.0:1788940657.154212:0:15140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718395392 00000100:00100000:3.0:1788940657.154272:0:15140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718395264 00000100:00100000:3.0:1788940657.154275:0:15140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718395264 00000100:00100000:3.0:1788940657.154304:0:15140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718395648 00000100:00100000:3.0:1788940657.154307:0:15140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718395648 00000100:00100000:3.0:1788940657.154319:0:15140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718395776 00000100:00100000:3.0:1788940657.154322:0:15140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718395776 00000100:00100000:3.0:1788940657.154348:0:15140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 22 00000100:00100000:3.0:1788940657.154362:0:15140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f191023480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b800dac5-5ff3-48f9-949d-d7448f32aa11+10:2351:x1875839718395392:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788940657.154466:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718395520 00000100:00100000:2.0:1788940657.154484:0:14456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718395520 00000100:00100000:2.0:1788940657.154584:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 35 00000100:00100000:2.0:1788940657.154594:0:14456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f191020000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36f240b4-a296-44d9-a5c6-bed8adad0c38+6:2351:x1875839718395520:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788940657.154709:0:14456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f191020000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36f240b4-a296-44d9-a5c6-bed8adad0c38+6:2351:x1875839718395520:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 114us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940657.154717:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 35 00000100:00100000:2.0:1788940657.154755:0:15139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 22 00000100:00100000:3.0:1788940657.154765:0:15140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f191023480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b800dac5-5ff3-48f9-949d-d7448f32aa11+10:2351:x1875839718395392:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 401us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940657.154775:0:15139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b6b54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b800dac5-5ff3-48f9-949d-d7448f32aa11+5:2349:x1875839718395264:12345-192.168.202.14@tcp:9:kworker.0 00000100:00100000:3.0:1788940657.154786:0:15140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 22 00000020:00000080:2.0:1788940657.154807:0:15139:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x27a633fcdd4be97 00000100:00100000:3.0:1788940657.154819:0:15140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 23 00000100:00080000:2.0:1788940657.154831:0:15139:0:(import.c:65:import_set_state_nolock()) ffff89f083ec8000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788940657.154834:0:15140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf557480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36f240b4-a296-44d9-a5c6-bed8adad0c38+5:2349:x1875839718395648:12345-192.168.202.14@tcp:9:kworker.0 00000020:00000080:3.0:1788940657.154872:0:15140:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x27a633fcdd4becf 00000001:00000004:2.0:1788940657.154893:0:15139:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934593 00000100:00080000:3.0:1788940657.154899:0:15140:0:(import.c:65:import_set_state_nolock()) ffff89f1befb7800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788940657.154955:0:15140:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934593 00010000:00010000:3.0:1788940657.155088:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940657.155147:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788940657.155166:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788940657.155174:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788940657.155177:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788940657.155313:0:15139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b6b54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b800dac5-5ff3-48f9-949d-d7448f32aa11+2:2349:x1875839718395264:12345-192.168.202.14@tcp:9:kworker.0 Request processed in 546us (1281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940657.155322:0:15139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 22 00000100:00100000:3.0:1788940657.155333:0:15140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf557480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36f240b4-a296-44d9-a5c6-bed8adad0c38+2:2349:x1875839718395648:12345-192.168.202.14@tcp:9:kworker.0 Request processed in 502us (1242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940657.155358:0:15140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 23 00000100:00100000:3.0:1788940657.156259:0:15140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 24 00000100:00100000:3.0:1788940657.156293:0:15140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36f240b4-a296-44d9-a5c6-bed8adad0c38+5:2349:x1875839718395776:12345-192.168.202.14@tcp:9:kworker.0 00000020:00000080:3.0:1788940657.156325:0:15140:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x27a633fcdd4bed6 00000100:00080000:3.0:1788940657.157327:0:15140:0:(import.c:65:import_set_state_nolock()) ffff89f1befb3800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788940657.157817:0:15140:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934598 00000100:00100000:3.0:1788940657.159981:0:15140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36f240b4-a296-44d9-a5c6-bed8adad0c38+2:2349:x1875839718395776:12345-192.168.202.14@tcp:9:kworker.0 Request processed in 3682us (5841us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940657.159999:0:15140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 24 00010000:00010000:0.0:1788940657.164220:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940657.326985:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 30800 lines, 30800 kept, 0 dropped, 0 bad.